-- Logs begin at Tue 2022-04-26 13:18:19 UTC, end at Tue 2022-04-26 14:27:55 UTC. -- Apr 26 14:01:00.881016 dv-cinder-835133-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 26 14:01:00.889624 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 26 14:01:00 2022] *** Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: nodename: dv-cinder-835133-2-iscsi Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: machine: x86_64 Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: clock source: unix Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: pcre jit disabled Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: detected number of CPU cores: 4 Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: current working directory: / Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: detected binary path: /usr/bin/uwsgi-core Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: your processes number limit is 47680 Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: your memory page size is 4096 bytes Apr 26 14:01:00.891707 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: detected max file descriptor number: 2048 Apr 26 14:01:00.892710 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: lock engine: pthread robust mutexes Apr 26 14:01:00.892710 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: thunder lock: enabled Apr 26 14:01:00.892710 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 26 14:01:00.892710 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 26 14:01:00.937399 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: Python main interpreter initialized at 0x5575297ba9c0 Apr 26 14:01:00.937399 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: python threads support enabled Apr 26 14:01:00.937399 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: your server socket listen backlog is limited to 100 connections Apr 26 14:01:00.937399 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: your mercy for graceful operations on workers is 90 seconds Apr 26 14:01:00.937749 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: mapped 403077 bytes (393 KB) for 2 cores Apr 26 14:01:00.937829 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: *** Operational MODE: preforking *** Apr 26 14:01:00.938066 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: *** uWSGI is running in multiple interpreter mode *** Apr 26 14:01:00.938066 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: spawned uWSGI master process (pid: 103182) Apr 26 14:01:00.938253 dv-cinder-835133-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 26 14:01:00.939144 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: spawned uWSGI worker 1 (pid: 103183, cores: 1) Apr 26 14:01:00.939144 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: spawned uWSGI worker 2 (pid: 103184, cores: 1) Apr 26 14:01:00.939301 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 26 14:01:02.105123 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 26 14:01:02.110329 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 26 14:01:02.960847 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:01:02.960847 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: from cryptography.utils import int_from_bytes Apr 26 14:01:02.961175 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:01:02.961175 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: from cryptography.utils import int_from_bytes Apr 26 14:01:02.961790 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:01:02.961790 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: from cryptography.utils import int_from_bytes Apr 26 14:01:02.962150 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:01:02.962150 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: from cryptography.utils import int_from_bytes Apr 26 14:01:05.472792 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 26 14:01:05.473225 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 26 14:01:05.473330 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 26 14:01:05.473679 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 26 14:01:05.473762 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 26 14:01:05.473905 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 26 14:01:05.474063 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 26 14:01:05.474197 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 26 14:01:05.474432 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 26 14:01:05.474584 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.474695 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 26 14:01:05.474909 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.475083 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.475236 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.475408 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.475556 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.475733 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.475883 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.476062 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.476213 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.476392 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.476516 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.476702 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.476834 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477032 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477158 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477354 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477439 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477682 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477777 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.477944 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.478164 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835133-2-iscsi {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.478284 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.478486 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.478608 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835133-2-iscsi {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.478793 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.478928 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.479102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.479222 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.479418 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.479531 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.479723 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.479829 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.480040 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.480134 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.480343 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.480443 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.480737 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.480822 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.481240 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.481379 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.481548 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.481670 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.481854 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.482003 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.482733 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.482877 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483065 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483162 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483381 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483514 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483685 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483783 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.483993 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.484085 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.484302 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.484387 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.484609 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.484709 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.484924 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.485010 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835133-2-iscsi {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.485317 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.485460 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835133-2-iscsi {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.485612 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.485743 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.485924 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.486045 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.486266 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.486358 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.486653 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.486755 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.486963 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.487049 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.487282 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.487383 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.487600 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.487698 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.487906 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.488001 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.488220 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.488305 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.488572 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.488682 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.488897 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489043 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489219 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489369 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489527 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489657 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489816 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.489958 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.490125 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.490268 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.490435 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.490580 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.490730 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.490883 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491029 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491192 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491340 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491488 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491634 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491775 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.491934 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.492091 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.492238 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.492384 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.492530 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.492693 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.492840 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493006 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493147 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493292 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493442 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493597 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493757 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.493914 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.494118 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.494265 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.494413 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.494575 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.494728 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.494870 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.495027 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.495169 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.495313 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.495581 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.495743 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.495899 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496056 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496201 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496348 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496504 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496648 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496798 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.496941 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.497089 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.497252 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.497413 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.497569 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.497723 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.497867 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498039 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498201 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498391 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498533 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498672 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498814 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.498965 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499230 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499331 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499413 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499537 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499648 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499808 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.499968 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500112 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500257 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500346 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500426 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500513 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500607 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500694 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500851 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.500992 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.501166 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.501299 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.501487 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.501618 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.501790 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.501941 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502060 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502273 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502367 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502526 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502640 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502828 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.502955 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.503134 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.503260 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.503453 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.503565 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.503772 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.503903 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.504185 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.504310 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.504502 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.504652 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.504792 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.504930 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.505089 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.505232 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.505374 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.505512 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.505724 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.505871 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.506085 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.506244 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.506388 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.506539 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.506676 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.506904 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507065 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507211 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507358 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507505 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507660 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507825 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.507968 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.508109 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.508109 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.508387 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.508534 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.508698 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.508858 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509006 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509006 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509306 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509449 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509603 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509603 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509866 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.509866 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.510158 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.510158 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.510453 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.510600 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.510757 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.510905 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.511055 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.511198 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.511365 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.511503 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.511647 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.511961 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.512123 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.512270 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.512429 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.512584 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.512744 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.512890 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513030 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513195 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513343 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513492 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513586 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513721 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513806 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.513946 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514144 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514313 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514462 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514583 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514675 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514765 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514847 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.514925 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515035 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515194 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515339 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515510 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515645 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515829 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.515946 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.516136 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.516263 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.516443 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.516586 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.516747 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.516902 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.517065 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.517210 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.517400 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.517518 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.517732 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.517839 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:01:05.518101 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.518215 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.518416 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.518503 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.518746 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.518854 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.519079 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.519175 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.519397 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.519483 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.519710 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.519844 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520024 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520113 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520348 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520443 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520661 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520747 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.520970 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.521065 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.521282 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.521368 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.521598 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.521681 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.521932 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522111 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522267 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522376 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522583 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522680 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522897 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.522991 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.523215 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.523308 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.523527 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.523614 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.523846 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.523939 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.524160 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.524246 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.524480 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.524573 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.524787 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.524989 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.525120 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.525206 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.525435 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.525531 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.525760 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.525898 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.526107 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.526197 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.526427 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.526532 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.526740 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.526828 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527051 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527136 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527362 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527462 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527674 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527790 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.527987 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.528082 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.528304 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.528398 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.528624 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.528712 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.529441 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.529534 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.529759 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.529856 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.530097 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.530198 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.530412 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.530501 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.530722 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.530815 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531036 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531122 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531350 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531438 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531664 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531750 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.531973 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532066 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532287 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532399 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532599 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532686 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532906 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.532998 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.533215 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.533301 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.533519 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.533607 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.533824 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.533917 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.534156 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.534256 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.534464 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.534552 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.534768 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.534853 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.535079 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.535194 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.535386 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.535472 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.535695 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.535780 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536020 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536114 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536322 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536431 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536632 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536720 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.536942 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537037 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537253 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537339 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537557 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537649 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537869 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.537963 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.538200 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.538538 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.538760 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.538849 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.539073 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.539160 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.539382 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.539468 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.539686 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.539778 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540010 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540105 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540317 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540403 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540621 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540750 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.540933 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541021 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541239 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541331 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541549 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541648 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541861 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.541948 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.542196 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.542284 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.542525 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.542691 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.542820 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.542916 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.543135 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.543223 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.543451 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.543551 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.543769 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.543858 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.544086 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.544171 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.544410 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.544506 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.545303 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.545402 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.545622 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.545717 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.545928 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546039 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546264 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546351 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546571 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546668 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546876 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.546965 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.547181 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.547268 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.547492 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.547579 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.547797 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.547885 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.548102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.548197 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.548409 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.548496 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.548712 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.548799 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549016 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549104 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549322 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549416 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549629 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549717 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.549931 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.550073 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.550257 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.550355 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.550562 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.550648 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.550874 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551008 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551184 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551280 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551527 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551613 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551834 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.551965 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.552169 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.552265 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.552491 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.552580 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.552804 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.552898 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.553123 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.553211 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.553435 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.553528 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.553747 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.553835 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.554084 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.554185 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.554396 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.554489 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.554710 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.554797 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555022 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555146 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555344 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555430 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555652 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555745 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.555974 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.556061 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.556283 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.556369 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.556605 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.556697 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.556911 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557008 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557230 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557322 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557545 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557639 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557865 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.557960 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.558218 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.558310 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.558540 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.558644 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.558852 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.558947 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.559171 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.559268 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.559482 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.559577 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.559792 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.559878 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.560104 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.560253 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.560461 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.560557 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.560781 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.560867 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.561090 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.561176 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.561411 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.561498 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.561723 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.561815 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.562064 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.562155 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.562378 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.562510 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.562696 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.562781 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563000 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563086 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563315 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563403 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563621 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563714 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.563942 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564029 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564268 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564355 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564581 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564673 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564898 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.564996 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.565207 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.565293 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.565516 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.565602 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.565829 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.565923 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.566166 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.566288 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.566472 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.566557 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.566779 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.566880 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.567089 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.567176 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.567399 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.567485 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.567709 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.567808 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568016 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568110 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568327 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568420 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568636 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568734 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.568939 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569024 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569242 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569328 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569549 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569635 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569856 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.569942 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.570191 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.570313 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.570514 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.570602 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.570827 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.570912 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.571130 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.571216 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.571435 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.571530 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.571754 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.571840 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572061 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572149 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572364 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572458 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572668 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572757 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.572970 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.573065 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.573271 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.573364 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.573578 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.573673 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.573901 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.574017 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.574247 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.574334 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.574562 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.574647 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.574871 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575036 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575186 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575277 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575494 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575580 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575821 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.575919 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.576138 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.576265 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.576450 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.576548 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.576761 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.576857 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.577072 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.577160 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.577382 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.577470 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.577694 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.577781 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578029 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578133 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578347 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578435 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578656 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578744 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.578967 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579055 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579278 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579370 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579577 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579671 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579888 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.579976 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.580193 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.580287 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.580505 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.580766 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.580853 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.581102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.581383 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.581481 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.581721 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.581808 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.582062 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.582151 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.582382 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.582480 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.582703 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.582790 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583024 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583119 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583357 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583446 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583662 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583757 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.583973 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584067 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584283 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584379 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584587 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584687 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584897 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.584984 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.585202 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.585288 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.585505 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.585599 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.585809 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.585895 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.586139 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.586228 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.586444 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.586589 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.586748 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.586843 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587050 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587138 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587353 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587441 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587656 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587743 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.587958 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588043 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588269 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588357 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588573 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588665 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588885 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.588973 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.589191 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.589286 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.589495 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.589583 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.589797 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.589884 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.590121 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.590211 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.590425 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.590561 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.590732 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.590833 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.591072 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.591159 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.591381 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.591999 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.592244 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.592341 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.592551 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.592644 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.592855 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.592942 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.593177 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.593273 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.593484 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.593582 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.593788 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.593883 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.594113 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.594214 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.594419 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.594506 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.594725 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.594820 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595026 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595113 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595336 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595421 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595641 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595728 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.595948 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596034 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596256 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596342 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596561 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596648 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596869 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.596956 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.597168 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.597260 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.597477 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.597571 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.597782 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.597874 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.598111 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.598203 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.598415 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.598517 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.598719 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.598806 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599023 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599111 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599322 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599476 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599633 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599721 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.599934 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600021 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600245 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600341 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600545 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600685 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600849 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.600937 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.601151 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.601238 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.601455 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.601549 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.601759 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.601847 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.602087 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.602177 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.602403 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.602489 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.602709 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.602806 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603012 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603107 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603316 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603410 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603624 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603711 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.603928 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604016 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604228 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604314 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604528 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604613 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604836 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.604925 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.605148 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.605235 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.605450 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.605545 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.605760 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.605854 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.606091 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.606183 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.606396 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.606495 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.606698 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.606784 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.607003 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.607130 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.607853 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.607951 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.608159 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.608254 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.608464 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.608558 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.608766 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.608853 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609067 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609153 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609370 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609455 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609675 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609763 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.609997 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610085 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610301 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610400 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610603 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610732 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610906 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.610999 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.611211 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.611299 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.611556 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.611651 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.611867 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.611984 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.612180 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.612291 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.612500 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.612584 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.612811 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.612899 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.613121 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.613217 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.613431 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.613519 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.613732 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.613818 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.614068 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.614170 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.614378 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.614478 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.614696 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.614783 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615000 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615094 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615306 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615399 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615610 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615704 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.615919 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616018 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616226 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616320 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616542 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616636 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616855 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.616944 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.617176 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.617263 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.617481 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.617567 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.617790 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.617884 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.618121 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.618210 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.618432 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.618535 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.618742 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.618829 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619050 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619143 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619358 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619445 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619670 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619757 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.619976 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620069 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620287 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620382 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620594 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620681 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620900 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.620985 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.621209 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.621303 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.621517 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.621608 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.621821 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.621910 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.622157 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.622258 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.622466 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.622561 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.622795 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.622885 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.623105 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.623210 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.623410 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.623497 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.623718 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.623811 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.624019 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.624105 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.624326 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.624447 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.624631 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.624758 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625060 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625149 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625362 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625448 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625671 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625757 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.625998 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.626100 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.626313 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.626399 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.626624 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.626709 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.626929 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.627018 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.627241 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.627349 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.627549 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.627648 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.627965 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628050 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628275 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628361 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628579 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628674 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628884 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.628971 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.629189 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.629274 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.629496 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.629595 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.629806 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.629898 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.630133 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.630224 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.630439 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.630540 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.630740 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.630826 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631045 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631136 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631361 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631447 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631664 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631791 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.631986 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.632103 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.632403 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.632492 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.632717 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.632803 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.633024 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.633110 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.633409 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.633511 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.633733 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.633822 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.634075 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.634166 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.634403 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.634500 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.634709 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.634796 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635024 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635274 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635413 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635504 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635639 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635728 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.635951 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636038 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636259 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636354 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636573 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636663 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636877 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.636964 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.637192 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.637295 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.637500 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.637588 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.637810 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.637907 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.638158 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.638842 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.638996 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.639099 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.639321 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.639419 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.639708 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.639805 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640029 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640118 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640348 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640433 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640650 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640742 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.640957 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641101 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641268 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641356 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641574 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641661 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641876 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.641987 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.642208 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.642307 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.642513 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.642620 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.642828 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.642921 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.643132 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.643220 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.643438 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.643526 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.643742 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.643839 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644046 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644150 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644349 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644436 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644657 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644745 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.644979 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.645082 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.645283 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.645370 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.645600 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.645687 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.645914 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646241 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646329 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646560 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646647 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646864 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.646961 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.647166 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.647254 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.647469 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.647564 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.647771 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.647867 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.648073 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.648160 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.648384 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.648478 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.648707 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.648795 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649022 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649110 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649346 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649433 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649654 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649742 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.649998 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.650106 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.650317 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.650403 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.650632 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.650726 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.650948 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651036 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651272 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651376 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651575 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651670 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651877 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.651965 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.652186 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.652283 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.652489 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.652575 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.652791 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.652884 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.653094 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.653192 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.653399 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.653486 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.653700 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.653787 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.654571 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.654681 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.654878 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.654972 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.655186 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.655298 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.655491 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.655586 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.655807 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.655894 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.656113 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.656198 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.656418 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.656507 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.656721 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.656809 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657022 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657111 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657325 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657417 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657629 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657717 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.657996 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.658087 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.658303 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.658392 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.658624 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.658718 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.658945 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659045 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659254 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659342 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659576 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659665 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659887 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.659982 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.660197 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.660284 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.660512 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.660601 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.660825 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.660923 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.661135 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.661270 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.661449 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.661537 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.661762 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.661862 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.662093 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.662195 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.662408 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.662497 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.662718 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.662812 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.663033 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.663120 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.663598 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.663807 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.663903 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.664136 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.664425 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.664513 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.664752 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.664840 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.665070 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.665164 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.665380 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.665467 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.665691 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.665778 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666022 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666122 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666336 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666423 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666644 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666741 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.666955 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667044 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667267 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667363 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667582 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667680 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667904 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.667991 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.668231 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.668317 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.668542 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.668638 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.668857 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.668945 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.669172 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.669260 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.669485 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.669574 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.669799 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.669886 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.670175 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.670268 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.670483 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.670572 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.670799 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.670889 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.671116 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.671222 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.671431 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.671524 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.671743 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.671839 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672054 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672152 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672365 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672464 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672677 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672765 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.672987 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.673088 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.673298 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.673386 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.673611 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.673703 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.673922 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.674039 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.674268 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.674357 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.674585 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.674673 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.674913 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675002 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675223 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675312 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675536 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675699 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675854 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.675951 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.676170 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.676375 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.676490 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.676692 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.677013 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.677102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.677332 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.677468 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.677654 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.677754 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678003 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678098 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678306 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678396 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678634 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678735 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.678941 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679028 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679248 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679346 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679560 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679657 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679873 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.679968 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.680178 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.680267 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.680492 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.680581 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.680801 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.680889 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.681105 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.681193 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.681425 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.681512 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.681733 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.681821 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.682087 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.682292 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.682392 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.682642 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.682928 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683016 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683272 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683374 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683589 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683677 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683905 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.683995 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.684212 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.684309 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.684537 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.684627 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.684843 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.684938 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.685168 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.685273 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.685510 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.685608 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.685824 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.685912 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.686164 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.686270 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.686471 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.686560 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.686783 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.686878 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.687092 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.687180 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.687399 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.687487 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.687711 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.687799 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688016 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688105 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688333 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688420 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688636 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688728 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.688940 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689035 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689245 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689341 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689553 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689641 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689858 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.689947 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.690183 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.690276 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.690490 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.690589 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.690839 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.690934 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.691100 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.691187 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.691401 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.691499 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.691711 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.691807 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692015 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692111 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692325 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692426 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692626 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692714 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.692936 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.693036 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.693244 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.693387 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.693556 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.693645 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.693887 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.694051 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.694215 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.694312 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.694838 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.694937 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.694937 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695092 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695188 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695270 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695439 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695528 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695747 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.695835 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.696065 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.696152 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.696378 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.696467 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.696726 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.696913 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.697046 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.697248 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.697569 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.697703 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.697904 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698026 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698260 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698349 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698568 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698658 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698874 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.698972 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.699178 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.699275 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.699501 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.699593 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.699812 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.699911 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.700125 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.700214 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.700435 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.700524 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.700745 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.701355 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.701571 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.701705 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.701882 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702014 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702217 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702308 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702528 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702617 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702837 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.702926 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.703146 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.703236 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.703453 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.703542 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.703760 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.703856 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.704072 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.704174 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.704386 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.704475 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.704704 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.704803 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705020 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705108 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705335 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705427 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705655 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705818 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.705979 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.706085 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.706293 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.706382 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.706606 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.706705 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.706915 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707008 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707232 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707321 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707542 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707630 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707859 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.707950 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.708163 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.708253 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.708489 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.708577 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.708802 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.708898 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.709188 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.709283 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.709510 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.709600 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.709821 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.709909 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.710165 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.710267 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.710477 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.710565 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.710785 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.710873 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.711105 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.711202 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.711415 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.711511 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.711740 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.711828 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.712052 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.712150 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.712383 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.712471 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.712705 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.712792 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713012 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713103 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713317 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713406 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713622 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713717 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.713932 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714050 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714270 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714366 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714580 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714668 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714885 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.714973 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.715187 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.715276 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.715492 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.715579 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.715794 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.715882 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.716099 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.716188 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.716417 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717045 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717247 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717337 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717550 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717636 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717852 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.717948 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.718183 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.718273 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.718487 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.718582 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.718786 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.718883 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719090 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719177 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719389 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719476 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719692 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719796 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.719990 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720078 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720293 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720383 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720593 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720683 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720896 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.720998 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.721192 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.721279 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.721495 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.721589 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.721798 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.721886 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.722163 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.722265 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.722490 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.722580 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.722802 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.722898 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.723124 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.723222 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.723435 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.723525 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.723756 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.723843 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.724069 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.724212 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.724381 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.724468 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.724691 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.724788 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725006 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725320 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725445 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725638 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725726 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.725949 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726078 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726283 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726373 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726594 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726683 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726904 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.726993 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.727216 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.727305 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.727529 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.727622 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.727832 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.727957 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.728155 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.728244 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.728462 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.728549 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.728780 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.728876 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.729097 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.729186 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.729409 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.729506 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.729725 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.729813 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730060 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730163 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730373 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730476 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730689 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730778 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.730997 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.731084 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.731304 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.731400 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.731614 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.731713 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.731928 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.732017 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.732276 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.732372 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.732601 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.732690 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.732927 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.733016 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.733254 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.733344 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.733595 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.733688 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.733905 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.734023 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.734276 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.734373 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.734589 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.734676 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.734908 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.735002 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.735220 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.735311 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.735531 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.735623 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.735775 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103184) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 26 14:01:05.735879 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.736156 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:01:05.736402 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103183) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 26 14:01:05.759063 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:05.759966 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_db.sqlalchemy.engines [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:05.821609 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.context [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),369c8e97-82c0-45fb-9c79-9f2a76ac131a(cell1) {{(pid=103184) load_cells /opt/stack/nova/nova/context.py:464}} Apr 26 14:01:05.822902 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.context [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),369c8e97-82c0-45fb-9c79-9f2a76ac131a(cell1) {{(pid=103183) load_cells /opt/stack/nova/nova/context.py:464}} Apr 26 14:01:05.826421 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_concurrency.lockutils [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:01:05.827592 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:01:05.827925 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_concurrency.lockutils [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:01:05.828777 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_concurrency.lockutils [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:01:05.829195 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:01:05.830132 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:01:05.830769 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_concurrency.lockutils [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103184) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:01:05.831967 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:01:05.841282 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:05.846223 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_db.sqlalchemy.engines [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:05.853212 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_db.sqlalchemy.engines [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:05.983682 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:06.004976 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG oslo_db.sqlalchemy.engines [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103184) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:06.008817 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_db.sqlalchemy.engines [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103183) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:01:06.561923 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: WARNING keystonemiddleware.auth_token [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:01:06.568677 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: WARNING keystonemiddleware.auth_token [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:01:06.597860 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: WARNING keystonemiddleware.auth_token [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:01:06.604593 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: WARNING keystonemiddleware.auth_token [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:01:06.792687 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: WARNING keystonemiddleware.auth_token [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:01:06.797935 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: WARNING keystonemiddleware.auth_token [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:01:06.803329 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575297ba9c0 pid: 103184 (default app) Apr 26 14:01:06.805394 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:01:06.806594 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] 10.222.0.23 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001766 Apr 26 14:01:06.806999 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 1/1] 10.222.0.23 () {50 vars in 788 bytes} [Tue Apr 26 14:01:06 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:01:06.829769 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: WARNING keystonemiddleware.auth_token [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:01:06.835024 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: WARNING keystonemiddleware.auth_token [None req-7d54c62b-c10b-4c39-8952-d2e27a59cfc2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:01:06.840335 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5575297ba9c0 pid: 103183 (default app) Apr 26 14:02:30.911215 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:30.912338 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Apr 26 14:02:30.912859 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 2/2] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:31.324437 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-7279f5a5-6378-4195-b9c8-f1d2dc49520f admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:31.354609 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-7279f5a5-6378-4195-b9c8-f1d2dc49520f admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.433910 Apr 26 14:02:31.355228 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 1/3] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Apr 26 14:02:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:02:33.678135 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:33.679145 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-db6c38ae-2a42-460e-b282-b55edb6f4ecf None None] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Apr 26 14:02:33.679556 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 3/4] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:33.744605 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-c94b5c3d-2f8b-42d3-9680-c6a7664408b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1"}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:33.762772 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:02:33.762772 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: warnings.warn(msg) Apr 26 14:02:33.866151 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-c94b5c3d-2f8b-42d3-9680-c6a7664408b7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.180122 Apr 26 14:02:33.866701 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 2/5] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:34.082831 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-80bd3e8a-34b1-4ec3-8aef-18f4228b172f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:34.085318 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:02:34.085318 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: warnings.warn(msg) Apr 26 14:02:34.184922 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-80bd3e8a-34b1-4ec3-8aef-18f4228b172f admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.310095 Apr 26 14:02:34.185856 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 4/6] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Apr 26 14:02:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:02:36.498612 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-c94b5c3d-2f8b-42d3-9680-c6a7664408b7 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:36.499633 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-c94b5c3d-2f8b-42d3-9680-c6a7664408b7 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Apr 26 14:02:36.500038 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 3/7] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:36.612948 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ea670608-8537-4d1d-ac61-c12f6f7b31eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:36.631184 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:02:36.631184 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: warnings.warn(msg) Apr 26 14:02:36.727236 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ea670608-8537-4d1d-ac61-c12f6f7b31eb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.221172 Apr 26 14:02:36.728296 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 5/8] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:36.740385 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-8a3d8607-cec5-4bfb-85fc-19c936b80a32 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:36.743059 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:02:36.743059 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: warnings.warn(msg) Apr 26 14:02:36.862187 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-8a3d8607-cec5-4bfb-85fc-19c936b80a32 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125674 Apr 26 14:02:36.862786 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 4/9] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Apr 26 14:02:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:02:39.193894 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ea670608-8537-4d1d-ac61-c12f6f7b31eb admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:39.194940 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ea670608-8537-4d1d-ac61-c12f6f7b31eb admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Apr 26 14:02:39.195478 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 6/10] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:39.256829 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-94436bbf-fa1e-4cec-892d-c9ca27c18da9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "swap": 0, "vcpus": 1}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:39.332854 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-94436bbf-fa1e-4cec-892d-c9ca27c18da9 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.131108 Apr 26 14:02:39.333400 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 5/11] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:39.345910 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-7422090e-c417-4e6d-bc19-8c1af92a64a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:39.445424 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-7422090e-c417-4e6d-bc19-8c1af92a64a6 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103145 Apr 26 14:02:39.446482 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 7/12] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Apr 26 14:02:39 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:02:41.788795 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-94436bbf-fa1e-4cec-892d-c9ca27c18da9 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:41.789931 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-94436bbf-fa1e-4cec-892d-c9ca27c18da9 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001838 Apr 26 14:02:41.790445 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 6/13] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:41.853985 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-843799c5-b3a9-495b-8749-050e4b166797 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "swap": 0, "id": "d3", "rxtx_factor": 1.0}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:41.960752 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-843799c5-b3a9-495b-8749-050e4b166797 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.163894 Apr 26 14:02:41.961316 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 8/14] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 26 14:02:41.973768 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-f2837290-0b5b-46ec-b013-352f931dc85e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:42.044827 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-f2837290-0b5b-46ec-b013-352f931dc85e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074853 Apr 26 14:02:42.045421 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 7/15] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Apr 26 14:02:41 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:02:44.391591 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-843799c5-b3a9-495b-8749-050e4b166797 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:44.392594 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-843799c5-b3a9-495b-8749-050e4b166797 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Apr 26 14:02:44.392991 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 9/16] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:44.466436 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-59c3d320-5a80-4df4-b11f-20315af1e01d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 4, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:44.542035 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-59c3d320-5a80-4df4-b11f-20315af1e01d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143046 Apr 26 14:02:44.543329 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 8/17] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:44.554470 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-9f236649-08c8-4fde-b597-e9928113e7d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:44.632132 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-9f236649-08c8-4fde-b597-e9928113e7d5 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080982 Apr 26 14:02:44.633015 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 10/18] 10.222.0.23 () {64 vars in 1335 bytes} [Tue Apr 26 14:02:44 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:02:46.988021 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-59c3d320-5a80-4df4-b11f-20315af1e01d admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:46.989270 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-59c3d320-5a80-4df4-b11f-20315af1e01d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Apr 26 14:02:46.989674 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 9/19] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:47.049102 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-0acfc95d-b337-496d-a1a9-684c4e1cdd5a admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:47.073860 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-0acfc95d-b337-496d-a1a9-684c4e1cdd5a admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077800 Apr 26 14:02:47.074789 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 11/20] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Apr 26 14:02:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:02:49.866789 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-59c3d320-5a80-4df4-b11f-20315af1e01d admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:49.867842 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-59c3d320-5a80-4df4-b11f-20315af1e01d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Apr 26 14:02:49.868193 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 10/21] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:02:49.931228 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-13df3982-e6d5-49fc-8bde-b4296c43d112 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:50.017459 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-13df3982-e6d5-49fc-8bde-b4296c43d112 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142996 Apr 26 14:02:50.018179 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 12/22] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 26 14:02:50.029934 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-888b5f9f-2e15-4563-a24a-d3fd9c159db3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:50.112478 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-888b5f9f-2e15-4563-a24a-d3fd9c159db3 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086158 Apr 26 14:02:50.113219 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 11/23] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Apr 26 14:02:50 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:02:52.465346 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-13df3982-e6d5-49fc-8bde-b4296c43d112 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:52.466400 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-13df3982-e6d5-49fc-8bde-b4296c43d112 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Apr 26 14:02:52.466813 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 13/24] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:52.525780 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-c2410e58-f897-4478-98fc-feee8118778b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "2", "disk": 20}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:52.613609 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-c2410e58-f897-4478-98fc-feee8118778b admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.140517 Apr 26 14:02:52.614431 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 12/25] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:52 2022] POST /compute/v2.1/flavors => generated 405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:52.626365 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-971d5d5e-7feb-4da3-9d25-139243544818 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:52.696172 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-971d5d5e-7feb-4da3-9d25-139243544818 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073282 Apr 26 14:02:52.696919 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 14/26] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Apr 26 14:02:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:02:55.038860 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-c2410e58-f897-4478-98fc-feee8118778b admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:55.039930 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-c2410e58-f897-4478-98fc-feee8118778b admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Apr 26 14:02:55.040351 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 13/27] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:55.098681 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-94ec112e-bab3-491c-bb3f-cba3e8733591 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "id": "3", "rxtx_factor": 1.0}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:55.166079 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-94ec112e-bab3-491c-bb3f-cba3e8733591 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.119181 Apr 26 14:02:55.167924 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 15/28] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:55 2022] POST /compute/v2.1/flavors => generated 406 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:55.178885 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-1570208e-0daf-434b-9f35-1bc464d45ca7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:55.270387 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-1570208e-0daf-434b-9f35-1bc464d45ca7 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085668 Apr 26 14:02:55.270387 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 14/29] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Apr 26 14:02:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:02:57.613638 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-94ec112e-bab3-491c-bb3f-cba3e8733591 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:02:57.614616 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-94ec112e-bab3-491c-bb3f-cba3e8733591 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Apr 26 14:02:57.615022 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 16/30] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:02:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:02:57.673441 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-65f92f00-19cb-4761-bf08-e4dce04d884d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "disk": 80, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:57.741926 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-65f92f00-19cb-4761-bf08-e4dce04d884d admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.121312 Apr 26 14:02:57.742523 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 15/31] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:02:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:02:57.754531 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-2dc5a3f6-89f9-469c-b7b2-8afea60cbf62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:02:57.838234 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-2dc5a3f6-89f9-469c-b7b2-8afea60cbf62 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087199 Apr 26 14:02:57.838822 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 17/32] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Apr 26 14:02:57 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:03:00.241070 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-65f92f00-19cb-4761-bf08-e4dce04d884d admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:00.242141 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-65f92f00-19cb-4761-bf08-e4dce04d884d admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Apr 26 14:03:00.242678 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 16/33] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:00.308934 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-7424f703-32cc-4491-9b20-10ebd221ba7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "id": "5", "rxtx_factor": 1.0, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:03:00.383645 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-7424f703-32cc-4491-9b20-10ebd221ba7e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.133609 Apr 26 14:03:00.384406 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 18/34] 10.222.0.23 () {64 vars in 1282 bytes} [Tue Apr 26 14:03:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 26 14:03:00.396338 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-422423d8-963e-4871-8f38-8a70273f79eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:03:00.482372 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-422423d8-963e-4871-8f38-8a70273f79eb admin admin] 10.222.0.23 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089574 Apr 26 14:03:00.482968 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 17/35] 10.222.0.23 () {64 vars in 1332 bytes} [Tue Apr 26 14:03:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:03:24.699228 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-7424f703-32cc-4491-9b20-10ebd221ba7e admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:24.700168 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-7424f703-32cc-4491-9b20-10ebd221ba7e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 26 14:03:24.700576 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 19/36] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:03:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:24.758135 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-1cac1423-f35c-4f16-ac71-ef56da64d6b9 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:24.775388 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-1cac1423-f35c-4f16-ac71-ef56da64d6b9 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068774 Apr 26 14:03:24.775924 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 18/37] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Apr 26 14:03:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:03:26.204035 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-7424f703-32cc-4491-9b20-10ebd221ba7e admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:26.205144 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-7424f703-32cc-4491-9b20-10ebd221ba7e admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Apr 26 14:03:26.205552 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 20/38] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:26.410470 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-34eec71e-9ef1-4df8-bc4b-3126045583e8 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:26.416378 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.wsgi [None req-34eec71e-9ef1-4df8-bc4b-3126045583e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 26 14:03:26.416883 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-34eec71e-9ef1-4df8-bc4b-3126045583e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:03:26.417751 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-34eec71e-9ef1-4df8-bc4b-3126045583e8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061733 Apr 26 14:03:26.418325 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 19/39] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Apr 26 14:03:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:26.427612 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-58c739a3-8472-4a0f-8ad1-a46f7953d2db admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:26.449588 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-58c739a3-8472-4a0f-8ad1-a46f7953d2db admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024770 Apr 26 14:03:26.450192 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 21/40] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Apr 26 14:03:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:03:26.459922 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-66c56209-15a4-48f3-a15d-0bccfdefe086 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:26.480435 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-66c56209-15a4-48f3-a15d-0bccfdefe086 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024173 Apr 26 14:03:26.480960 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 20/41] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Apr 26 14:03:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:03:26.489998 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-0592de99-826d-4e9c-a552-3b2cbd748f93 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:26.496255 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.wsgi [None req-0592de99-826d-4e9c-a552-3b2cbd748f93 admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 26 14:03:26.496847 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-0592de99-826d-4e9c-a552-3b2cbd748f93 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:03:26.497630 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-0592de99-826d-4e9c-a552-3b2cbd748f93 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.011212 Apr 26 14:03:26.498151 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 22/42] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Apr 26 14:03:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:27.754686 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-66c56209-15a4-48f3-a15d-0bccfdefe086 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:27.755718 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-66c56209-15a4-48f3-a15d-0bccfdefe086 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Apr 26 14:03:27.756115 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 21/43] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:27.947810 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-2af0b6e7-7474-4708-89a6-3e2bed798e6b admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:27.953067 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.wsgi [None req-2af0b6e7-7474-4708-89a6-3e2bed798e6b admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 26 14:03:27.953622 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-2af0b6e7-7474-4708-89a6-3e2bed798e6b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:03:27.954441 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-2af0b6e7-7474-4708-89a6-3e2bed798e6b admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059092 Apr 26 14:03:27.954951 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 23/44] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Apr 26 14:03:27 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:27.964877 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5c1e7a29-6338-4ef3-a379-f511f73e6ffe admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:27.977908 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5c1e7a29-6338-4ef3-a379-f511f73e6ffe admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017170 Apr 26 14:03:27.978464 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 22/45] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Apr 26 14:03:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:03:27.988148 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-efaf9d95-0805-43cc-bb15-6bbf7d238f21 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:28.001417 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-efaf9d95-0805-43cc-bb15-6bbf7d238f21 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016767 Apr 26 14:03:28.001976 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 24/46] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Apr 26 14:03:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:03:28.010788 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-f7bda8bd-8a3c-4d12-a5cd-e56e490923c0 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:28.015771 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.wsgi [None req-f7bda8bd-8a3c-4d12-a5cd-e56e490923c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 26 14:03:28.016326 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-f7bda8bd-8a3c-4d12-a5cd-e56e490923c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:03:28.017099 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-f7bda8bd-8a3c-4d12-a5cd-e56e490923c0 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.009790 Apr 26 14:03:28.017592 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 23/47] 10.222.0.23 () {60 vars in 1190 bytes} [Tue Apr 26 14:03:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:29.318239 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-efaf9d95-0805-43cc-bb15-6bbf7d238f21 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:29.319241 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-efaf9d95-0805-43cc-bb15-6bbf7d238f21 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Apr 26 14:03:29.319640 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 25/48] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:29.507913 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-1a699cf6-ec17-4ea8-a17d-0ea13c98160d admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:29.513102 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.wsgi [None req-1a699cf6-ec17-4ea8-a17d-0ea13c98160d admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 26 14:03:29.513662 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-1a699cf6-ec17-4ea8-a17d-0ea13c98160d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103183) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:03:29.514488 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-1a699cf6-ec17-4ea8-a17d-0ea13c98160d admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.057767 Apr 26 14:03:29.514995 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 24/49] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Apr 26 14:03:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:29.524217 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-b448e0ad-74d9-46c7-ab79-fe55d27afbc8 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:29.538503 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-b448e0ad-74d9-46c7-ab79-fe55d27afbc8 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017526 Apr 26 14:03:29.539021 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 26/50] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Apr 26 14:03:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:03:29.549109 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:29.562167 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016944 Apr 26 14:03:29.562689 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 25/51] 10.222.0.23 () {60 vars in 1210 bytes} [Tue Apr 26 14:03:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:03:29.571742 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-b126b7fd-e1b6-497e-a881-a002d597cc14 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:29.577354 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.wsgi [None req-b126b7fd-e1b6-497e-a881-a002d597cc14 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 26 14:03:29.577917 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-b126b7fd-e1b6-497e-a881-a002d597cc14 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103184) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:03:29.578723 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-b126b7fd-e1b6-497e-a881-a002d597cc14 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010579 Apr 26 14:03:29.579221 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 27/52] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Apr 26 14:03:29 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 26 14:03:30.919259 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:30.920279 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Apr 26 14:03:30.920670 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 26/53] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:31.119848 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-fe75a1f1-4a82-4cbe-8a83-338fbded8263 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:03:31.189094 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-fe75a1f1-4a82-4cbe-8a83-338fbded8263 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.121043 Apr 26 14:03:31.189659 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 28/54] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Apr 26 14:03:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:03:32.510311 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:32.511319 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Apr 26 14:03:32.511741 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 27/55] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:32.702317 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-166c2827-3209-4b5a-bfa7-7c16e2390b62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:03:32.756579 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-166c2827-3209-4b5a-bfa7-7c16e2390b62 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.105567 Apr 26 14:03:32.757125 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Apr 26 14:03:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:03:34.029459 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:34.030518 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Apr 26 14:03:34.030912 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 28/57] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:03:34.231087 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-b41f0aea-67b9-4268-b28e-15dc8e5ed86e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:03:34.285188 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-b41f0aea-67b9-4268-b28e-15dc8e5ed86e admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.105342 Apr 26 14:03:34.285668 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 30/58] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Apr 26 14:03:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:03:35.547177 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:35.548164 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Apr 26 14:03:35.548553 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 29/59] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:35.740494 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-04d674b4-7314-486d-8427-beea92240448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:03:35.826133 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-04d674b4-7314-486d-8427-beea92240448 admin admin] 10.222.0.23 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.135704 Apr 26 14:03:35.826702 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 31/60] 10.222.0.23 () {64 vars in 1235 bytes} [Tue Apr 26 14:03:35 2022] POST /compute/v2.1/flavors => generated 409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:03:37.076514 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:37.077506 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Apr 26 14:03:37.077901 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 30/61] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:03:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:03:37.263433 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-d3b2d061-b31f-43b7-a042-f057b61c2f86 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:03:37.282083 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-d3b2d061-b31f-43b7-a042-f057b61c2f86 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068955 Apr 26 14:03:37.282611 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 32/62] 10.222.0.23 () {60 vars in 1202 bytes} [Tue Apr 26 14:03:37 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:04:23.302298 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:04:23.303305 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5a477a15-4428-46aa-a761-7f4a7e130953 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Apr 26 14:04:23.303698 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 31/63] 10.222.0.23 () {54 vars in 930 bytes} [Tue Apr 26 14:04:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:04:23.360296 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-a5772fa2-2553-4f16-87ef-840e95769f4e admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:04:23.379528 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-a5772fa2-2553-4f16-87ef-840e95769f4e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069541 Apr 26 14:04:23.380061 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 33/64] 10.222.0.23 () {60 vars in 1291 bytes} [Tue Apr 26 14:04:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:04:23.401949 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5ce22976-b580-46cb-af13-d32a9258a42e admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:04:23.409395 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5ce22976-b580-46cb-af13-d32a9258a42e admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011078 Apr 26 14:04:23.409910 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 32/65] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Apr 26 14:04:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:04:23.421178 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-86f3a020-3826-4509-a394-c02789122ae3 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:04:23.428491 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-86f3a020-3826-4509-a394-c02789122ae3 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010787 Apr 26 14:04:23.429002 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 34/66] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Apr 26 14:04:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:04:23.440542 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-3d83acbc-c9cf-4261-8ac6-12509e8437fa admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:04:23.448769 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-3d83acbc-c9cf-4261-8ac6-12509e8437fa admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011773 Apr 26 14:04:23.449295 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 33/67] 10.222.0.23 () {60 vars in 1285 bytes} [Tue Apr 26 14:04:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:04:23.460573 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:04:23.467991 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] 10.222.0.23 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011003 Apr 26 14:04:23.468503 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 35/68] 10.222.0.23 () {60 vars in 1282 bytes} [Tue Apr 26 14:04:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:06:23.381414 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-2d8972fb-a7d5-42d3-9054-76023efb73ce tempest-verify_tempest_config-147441943 tempest-verify_tempest_config-147441943-project] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:06:23.383412 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-2d8972fb-a7d5-42d3-9054-76023efb73ce tempest-verify_tempest_config-147441943 tempest-verify_tempest_config-147441943-project] 10.222.0.23 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.104663 Apr 26 14:06:23.384500 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Apr 26 14:06:23 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:08:05.432353 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:05.433353 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 26 14:08:05.434063 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 36/70] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:08:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:08:05.687868 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-dd232f78-eb14-4e56-8644-c2f7c6dd2696 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:05.689078 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:08:05.689078 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: warnings.warn(msg) Apr 26 14:08:05.690306 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-dd232f78-eb14-4e56-8644-c2f7c6dd2696 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:05.690747 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-dd232f78-eb14-4e56-8644-c2f7c6dd2696 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:05.691541 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-dd232f78-eb14-4e56-8644-c2f7c6dd2696 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:05.691970 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-dd232f78-eb14-4e56-8644-c2f7c6dd2696 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:05.724513 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-dd232f78-eb14-4e56-8644-c2f7c6dd2696 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152730 Apr 26 14:08:05.725072 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 35/71] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Apr 26 14:08:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:08:06.998908 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:06.999899 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Apr 26 14:08:07.000293 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 37/72] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:08:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:08:07.191842 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-1db08dbd-cbff-4e67-a9f2-4cfde4607cb3 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:07.193040 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:08:07.193040 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: warnings.warn(msg) Apr 26 14:08:07.194242 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-1db08dbd-cbff-4e67-a9f2-4cfde4607cb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:07.194676 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-1db08dbd-cbff-4e67-a9f2-4cfde4607cb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:07.195469 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-1db08dbd-cbff-4e67-a9f2-4cfde4607cb3 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:07.195889 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-1db08dbd-cbff-4e67-a9f2-4cfde4607cb3 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:07.217346 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-1db08dbd-cbff-4e67-a9f2-4cfde4607cb3 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077952 Apr 26 14:08:07.217827 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 36/73] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Apr 26 14:08:07 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 26 14:08:18.880492 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:18.881527 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Apr 26 14:08:18.881922 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 38/74] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:08:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:08:19.067948 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-5eb30415-6c5d-4fa6-8bf2-698347b5b8d3 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:19.069171 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:08:19.069171 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: warnings.warn(msg) Apr 26 14:08:19.070397 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-5eb30415-6c5d-4fa6-8bf2-698347b5b8d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:19.070839 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-5eb30415-6c5d-4fa6-8bf2-698347b5b8d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:19.071659 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-5eb30415-6c5d-4fa6-8bf2-698347b5b8d3 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:19.072088 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-5eb30415-6c5d-4fa6-8bf2-698347b5b8d3 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:19.096063 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-5eb30415-6c5d-4fa6-8bf2-698347b5b8d3 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079234 Apr 26 14:08:19.096543 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 37/75] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Apr 26 14:08:19 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:08:20.350329 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: DEBUG nova.api.openstack.wsgi [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] Calling method '>' {{(pid=103184) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:20.351322 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: INFO nova.api.openstack.requestlog [None req-ab33f820-892f-4574-9a4c-44480ab6a029 admin admin] 10.222.0.23 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Apr 26 14:08:20.351723 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: [pid: 103184|app: 0|req: 39/76] 10.222.0.23 () {56 vars in 1074 bytes} [Tue Apr 26 14:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:08:20.538816 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG nova.api.openstack.wsgi [None req-60d9186c-8cd7-4426-bf98-6c26884ef524 admin admin] Calling method '>' {{(pid=103183) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:08:20.539970 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 26 14:08:20.539970 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: warnings.warn(msg) Apr 26 14:08:20.541174 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-60d9186c-8cd7-4426-bf98-6c26884ef524 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:20.541602 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-60d9186c-8cd7-4426-bf98-6c26884ef524 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:20.542434 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-60d9186c-8cd7-4426-bf98-6c26884ef524 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:08:20.542854 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: DEBUG oslo_concurrency.lockutils [None req-60d9186c-8cd7-4426-bf98-6c26884ef524 admin admin] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103183) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:08:20.564236 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: INFO nova.api.openstack.requestlog [None req-60d9186c-8cd7-4426-bf98-6c26884ef524 admin admin] 10.222.0.23 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075902 Apr 26 14:08:20.564718 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: [pid: 103183|app: 0|req: 38/77] 10.222.0.23 () {60 vars in 1193 bytes} [Tue Apr 26 14:08:20 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:09:18.537458 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: Tue Apr 26 14:09:18 2022 - graceful shutdown triggered... Apr 26 14:09:18.537943 dv-cinder-835133-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 26 14:09:18.538748 dv-cinder-835133-2-iscsi devstack@n-api.service[103183]: Gracefully killing worker 1 (pid: 103183)... Apr 26 14:09:18.539245 dv-cinder-835133-2-iscsi devstack@n-api.service[103184]: Gracefully killing worker 2 (pid: 103184)... Apr 26 14:09:19.538267 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: worker 1 buried after 1 seconds Apr 26 14:09:19.538694 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: worker 2 buried after 1 seconds Apr 26 14:09:19.538694 dv-cinder-835133-2-iscsi devstack@n-api.service[103182]: goodbye to uWSGI. Apr 26 14:09:19.539815 dv-cinder-835133-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 26 14:09:19.540382 dv-cinder-835133-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 26 14:09:19.543212 dv-cinder-835133-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 26 14:09:19.559971 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Apr 26 14:09:19 2022] *** Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: nodename: dv-cinder-835133-2-iscsi Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: machine: x86_64 Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: clock source: unix Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: pcre jit disabled Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: detected number of CPU cores: 4 Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: current working directory: / Apr 26 14:09:19.576747 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: detected binary path: /usr/bin/uwsgi-core Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: your processes number limit is 47680 Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: your memory page size is 4096 bytes Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: detected max file descriptor number: 2048 Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: lock engine: pthread robust mutexes Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: thunder lock: enabled Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 26 14:09:19.577538 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 26 14:09:19.624340 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: Python main interpreter initialized at 0x55cd222ef9c0 Apr 26 14:09:19.624340 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: python threads support enabled Apr 26 14:09:19.624340 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: your server socket listen backlog is limited to 100 connections Apr 26 14:09:19.624340 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: your mercy for graceful operations on workers is 90 seconds Apr 26 14:09:19.624778 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: mapped 403077 bytes (393 KB) for 2 cores Apr 26 14:09:19.624778 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: *** Operational MODE: preforking *** Apr 26 14:09:19.624940 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: *** uWSGI is running in multiple interpreter mode *** Apr 26 14:09:19.624940 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: spawned uWSGI master process (pid: 117580) Apr 26 14:09:19.625149 dv-cinder-835133-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 26 14:09:19.626742 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: spawned uWSGI worker 1 (pid: 117600, cores: 1) Apr 26 14:09:19.626742 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: spawned uWSGI worker 2 (pid: 117601, cores: 1) Apr 26 14:09:19.626742 dv-cinder-835133-2-iscsi devstack@n-api.service[117580]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 26 14:09:20.803640 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 26 14:09:20.822936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 26 14:09:21.718214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:09:21.718214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: from cryptography.utils import int_from_bytes Apr 26 14:09:21.718523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:09:21.718523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: from cryptography.utils import int_from_bytes Apr 26 14:09:21.735580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:09:21.735580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: from cryptography.utils import int_from_bytes Apr 26 14:09:21.735902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 26 14:09:21.735902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: from cryptography.utils import int_from_bytes Apr 26 14:09:24.086845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 26 14:09:24.087390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 26 14:09:24.087687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 26 14:09:24.088002 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 26 14:09:24.088268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 26 14:09:24.088652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.088986 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.089315 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.089640 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.090002 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.090309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.090642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.090966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.091298 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.091564 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.091884 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.092214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835133-2-iscsi {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.092540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.092856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.093174 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.093497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.093804 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.094163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.094476 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.094980 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.096447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.096447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.096447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.096447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.097280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.097280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.097280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.097898 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.097898 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.098330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.098624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835133-2-iscsi {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.098946 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.099308 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.099590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.100027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.100323 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.100639 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.101437 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.101437 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.101619 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.101913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.102267 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.102586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.102913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.103218 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.103531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.103846 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.104171 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.104483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.104791 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.105048 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.105363 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.105692 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.106036 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.106375 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.106630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.106883 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.107214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.107540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.107853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.108166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.108479 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.108792 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.109102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.109413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.109724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.110056 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.110425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.110697 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.111025 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.111338 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.111661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.112068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.112324 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.112630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.113079 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.113334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.113607 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.113933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.114283 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.115105 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.115434 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.115827 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.116106 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.116452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.116762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.117017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.117328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.117641 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.117991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.118298 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.118611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.118925 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.119227 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.119537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.119849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.120159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.120477 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.120783 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.121091 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.121402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.121712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.122160 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.122371 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.122521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 26 14:09:24.123128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.123445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 26 14:09:24.123685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.123685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.123997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 26 14:09:24.124259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.124498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 26 14:09:24.124645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.124800 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 26 14:09:24.124957 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.125099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.125247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.125397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.125540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.125689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.125844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.126212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.126369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.126512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.126665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.126828 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.126977 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127119 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127266 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127549 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127703 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.127986 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.128134 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.128477 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.128639 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.128790 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835133-2-iscsi {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.129013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.129311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.129469 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.129613 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.129790 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.129951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.130140 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.130336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131108 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131258 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.131996 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.132147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.132412 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.132580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.132753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.132909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.133069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.133303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.133662 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.133927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.134139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.134308 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.134558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.134714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.134864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.135006 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.135147 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.135287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.135435 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.135587 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.135730 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.135879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.136027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.136205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.136205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.136587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835133-2-iscsi {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.136730 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.136880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.137031 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.137185 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.137334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.137486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.137627 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.137775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.137919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.138142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.138287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.138428 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.138569 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.138718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.138860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.139016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.139168 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.139333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.139552 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.139712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.139854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.140020 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.140175 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.140316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.140467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.140616 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.140771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.140920 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.141084 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.141294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.141451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.141599 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.141753 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.141895 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.142078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.142224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.142394 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.142748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.142913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.143064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.143207 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.143437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.143745 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.143913 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.144135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.144289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.144438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.144614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.144847 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.145005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.145159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.145313 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.145464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.145606 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.145753 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.145937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.146129 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.146286 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.146457 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.146689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.146849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.146999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.147141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.147282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.147429 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.147578 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.147729 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.147881 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.148032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.148180 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.148321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.148474 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.148627 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.148769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.148911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.149058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.149199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.149339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.149494 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.149723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.149869 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.150056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.150206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.150357 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.23 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.150510 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.150650 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.23 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.150798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.150948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.151090 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.151245 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.151483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.151639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.151789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.151930 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.152132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.152301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.152451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.152605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.152765 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.152987 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.153146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.153296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.153455 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.153668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.153960 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.154163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.154396 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.154543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.154686 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.154845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.155089 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.155235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.155393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.155393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.155393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.155815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.155965 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.156117 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.156966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.157129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.157283 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.157438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.157580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.157731 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.157888 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.158327 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.158496 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.158659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.158911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.158911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.159220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.159220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.159513 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.159682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.159939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.160088 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.160229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.160370 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.160518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.160670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.160819 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.160981 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.161132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.161275 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.161425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.161710 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.161871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.162033 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.162196 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.162339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.162489 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.162631 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.163129 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.163278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.163430 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.163580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.163825 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.164155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.164311 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.164577 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.164726 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.164867 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.165017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.165289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.165438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.165594 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.165742 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.165900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.166076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.166220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.166380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.166530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.166683 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.166832 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.167105 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.167255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.167407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.167561 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.167711 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.167860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.168010 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.168152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.168309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.168462 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.168614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.168762 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.168917 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.169060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.169212 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.169356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.169497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.169647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.169873 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.170239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.170396 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.170552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.170694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.170856 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.171011 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.171404 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.171735 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.171900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.172046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.172201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.172356 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.172512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.172653 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.172791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.172930 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.173079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.173264 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.173411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.173553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.173692 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 26 14:09:24.173858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174004 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174262 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174809 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.174994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175205 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175364 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175857 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.175948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176184 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176290 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176384 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176738 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176831 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.176923 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.177019 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.177665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.177765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.177861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.177947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178169 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178254 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178480 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178666 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.178976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179293 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179422 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179681 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179805 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.179956 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180573 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180678 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180771 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.180953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181360 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181458 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.181732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182453 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182601 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182739 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182830 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182914 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.182997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183079 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183171 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183257 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183403 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183492 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183577 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.183940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.184079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.184208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.184436 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.184561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.184700 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.184839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185198 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185290 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185439 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185570 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185840 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.185939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186374 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186513 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186667 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.186940 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187366 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187823 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187896 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.187985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188308 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188493 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188721 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.188919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189339 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189871 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.189962 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.190229 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.190410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.190535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.190627 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.190847 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.190938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.191180 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.191273 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.191494 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.191594 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.191808 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.191918 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.192121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.192222 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.192437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.192531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.192795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.193404 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.193633 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.193727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.193956 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.194126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.194288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.194420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.194604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.194723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.194937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.195064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.195352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.195526 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.195695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.195864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.196009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.196186 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.196343 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.196512 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.196676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.196834 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197000 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197494 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197829 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.197947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.199439 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.199602 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.199714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.199802 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.199896 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.199981 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200426 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200676 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.200952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201051 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201144 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201404 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201588 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.201862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.202959 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203273 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203489 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203799 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.203984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204608 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204700 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.204919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.205011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.205270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.205362 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.205579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.205678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.205923 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.206171 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.206260 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.206349 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.206582 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.206680 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.206912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.207967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.208171 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.208262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209641 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209740 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.209948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.210062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.210283 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.210377 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.210598 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.210694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.210912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211003 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.211937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.212167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.212306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.212467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.212559 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.212780 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.212879 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.213085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.213185 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.213391 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.213483 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.213704 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.213796 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214038 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214137 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.214966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215066 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215375 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215692 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.215988 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.216204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.216294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.216518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.216675 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.216830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.216922 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.217138 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.217230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.217459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.217562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.217776 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.217879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.218107 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.218199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.218420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.218515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.218731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.218821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219198 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219355 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219460 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219666 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.219976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.220068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.220296 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.220398 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.220604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.220705 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.220912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221220 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.221938 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.222173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.222278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.222478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.222572 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.222785 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.222892 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.223091 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.223196 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.223397 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.223496 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.223704 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.223814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.224581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.224679 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.224913 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225335 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225538 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225628 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225848 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.225945 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.226221 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.226325 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.226527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.226617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.226849 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.226938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.227179 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.227271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.227496 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.227592 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.227814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.227911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.228126 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.228224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.228440 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.228531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.228755 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.228852 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.229064 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.229170 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.229395 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.229540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.229692 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.229799 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230153 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230336 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230477 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230644 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.230967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.231129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.231265 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.231447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.231580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.231767 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.231907 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.232084 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.232233 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.232397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.232559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.232714 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.232866 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.233038 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.233179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.233490 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.233628 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.233803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234140 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234767 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.234983 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.235082 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.235311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.235402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.235650 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.235742 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.235988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.236085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.236302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.236393 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.236617 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.236718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.236930 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237030 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237332 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237550 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.237994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.238201 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.238292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.238515 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.238604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.238824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.238923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.239138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.239228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.239444 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.239602 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.240295 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.240459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.240612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.240781 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.240926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.241097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.241251 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.241410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.241564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.241728 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.241885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.242070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.242221 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.242390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.242612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.242736 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.242866 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.243010 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.243179 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.243435 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.243534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.243755 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.243854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.244073 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.244178 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.244389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.244483 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.244699 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.244790 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245323 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.245962 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.246127 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.246304 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.246404 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.246613 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.246712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.246940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.247041 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.247249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.247342 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.247580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.247742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.247906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.248005 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.248214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.248306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.248531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.248630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.248846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249018 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249162 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249776 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.249961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.250116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.250309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.250454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.250638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.250734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.250947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.251039 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.251266 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.251367 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.251580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.251681 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.251910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252046 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252227 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252629 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252853 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.252945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.253161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.253264 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.253486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.253575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.253795 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.253892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.254128 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.254234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.254438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.254536 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.254751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.254875 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.255065 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.255216 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.255961 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.256091 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.256295 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.256419 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.256614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.256752 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.256927 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.257064 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.257237 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.257373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.257553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.257694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.257865 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258664 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.258996 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.259168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.259270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.259480 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.259573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.259797 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.259931 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.260109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.260210 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.260420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.260554 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.260729 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.260824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261042 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261660 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.261981 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.262097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.262297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.262399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.262607 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.262707 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.262938 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263040 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263253 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263351 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263877 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.263967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.264184 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.264273 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.264531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.264627 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.264837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.264938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.265161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.265250 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.265498 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.265590 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.265818 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.265908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.266164 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.266256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.266481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.266584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.266800 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.266894 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.267120 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.267210 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.267433 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.267533 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.267754 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.267845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268061 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268158 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268370 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268476 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.268987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.269087 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.269300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.269400 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.269610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.269708 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.269922 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270125 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270376 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270888 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.270999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.271223 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.271358 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.271534 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.271626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.271861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.271971 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.272176 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.272265 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.272483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.272579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.272793 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.272929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.273102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.273202 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.273424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.273522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.273742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.273841 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.274091 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.274187 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.274414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.274505 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.274732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.274835 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.275051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.275143 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.275367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.275458 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.275676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.275774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276005 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276106 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276426 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276728 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.276953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.277043 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.277267 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.277373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.277585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.277684 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.277898 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.278003 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.278288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.278401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.278556 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.278729 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.278874 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.279051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.279197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.279368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.279690 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.279781 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280109 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280335 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280426 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280660 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.280976 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.281065 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.281295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.281395 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.281616 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.281708 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.281934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.282061 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.282278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.282371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.282596 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.282699 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.282913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283675 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.283987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.284197 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.284288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.284509 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.284607 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.284838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.284942 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.285626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.285728 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.285728 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.285884 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.285992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286190 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286275 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286455 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286778 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.286950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.287099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.287269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.287419 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.287587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.287994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.288171 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.288312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.288501 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.288632 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.288833 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.288934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.289144 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.289237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.289465 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.289565 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.289784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.289889 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.290139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.290232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.290472 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.290568 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.290792 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.290892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.291116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.291208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.291428 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.291572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.291747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.291838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.292070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.292163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.292389 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.292595 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.292717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.292915 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.293139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.293253 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.293474 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.293576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.293791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.293891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.294215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.294308 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.294540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.294645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.294851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.294950 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.295163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.295263 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.295470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.295570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.295784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.295882 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.296094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.296192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.296403 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.296495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.296719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.296817 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297030 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297433 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.297962 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.298114 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.298305 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.298557 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.298658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.298922 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299014 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299248 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299341 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299897 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.299996 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.300219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.300318 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.300528 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.300624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.300858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.300995 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.301171 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.301265 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.301481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.301571 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.301794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.301889 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.302665 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.302818 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.302978 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.303069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.303293 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.303457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.303611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.303715 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.303926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.304024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.304235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.304343 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.304553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.304659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.304865 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305002 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305299 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305507 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305599 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305818 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.305918 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.306152 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.306263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.306470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.306570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.306782 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.306882 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.307094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.307193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.307403 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.307495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.307713 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.307812 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308020 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308332 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308736 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.308947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309044 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309252 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309649 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309876 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.309986 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.310229 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.310321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.310549 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.310769 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.310873 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.310988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.311158 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.311311 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.311453 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.311552 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.311783 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.311881 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.312099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.312328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.312428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.312523 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.312721 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.312813 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.313070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.313172 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.313392 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.313498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.313710 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.313932 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.314058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.314314 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.314420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.314643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.314735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.314983 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.315084 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.315312 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.315416 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.315621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.315719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.315933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.316031 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.316244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.316349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.316575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.316686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.316893 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.317012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.317208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.317335 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.317525 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.318332 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.318445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.318726 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.318868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319042 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319206 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319359 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.319988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.320176 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.320303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.320499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.320604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.320819 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.320913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.321138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.321239 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.321457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.321604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.321776 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.321912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.322133 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.322229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.322473 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.322580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.322801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.322893 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.323122 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.323255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.323439 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.323547 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.323755 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.323855 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.324067 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.324167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.324390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.324489 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.324712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.324803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.325027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.325154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.325337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.325437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.325682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.325780 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326139 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326348 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326476 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326669 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326799 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.326988 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.327094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.327303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.327402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.327625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.327718 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.328502 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.328624 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.328624 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.328793 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.328887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.328981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329076 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329218 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329405 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329489 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329582 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329813 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.329907 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.330170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.330262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.330481 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.330571 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.330790 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.330886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.331102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.331201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.331425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.331630 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.331738 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.331952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.332045 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.332296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.332398 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.332626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.332717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.332934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.333027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.333240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.333350 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.333582 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.333675 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.333891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334332 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334843 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.334949 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.335150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.335291 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.335457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.335550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.335764 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.335863 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.336072 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.336181 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.336385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.336477 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.336691 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.336789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.337045 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.337158 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.337309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.337538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.337628 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.337895 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.338012 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.338257 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.338356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.338589 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.338680 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.338909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339008 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339233 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339332 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339547 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339637 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339874 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.339976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.340186 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.340286 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.340499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.340629 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.340821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.340993 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.341137 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.341228 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.341447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.341583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.341759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.341864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.342098 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.342206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.342415 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.342502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.342724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.342816 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343038 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.343988 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.344085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.344301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.344399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.344610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.344710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.344928 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345379 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.345981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.346210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.346316 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.346531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.346624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.346845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.346943 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.347158 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.347262 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.347469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.347568 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.347782 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.347878 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.348093 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.348197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.348412 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.348504 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.348730 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.348827 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.349095 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.349226 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.349429 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.349653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.349749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350126 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350423 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350644 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350781 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.350976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.351081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.351297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.351389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.351616 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.351750 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.351972 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.352078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.352295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.352388 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.352542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 26 14:09:24.352838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.353181 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.353510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.353861 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.354226 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.354542 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.354858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.355173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.355507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.355828 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.356146 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.356465 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.356782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.357101 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.357419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.357737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.358154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.358474 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.358792 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.359123 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.359426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.359748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.360096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.360422 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.360747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.361070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.361396 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.361907 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.362064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.362354 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.362670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.362992 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.363331 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.363653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.363973 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.364401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.365254 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.365577 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.365905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.366674 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.367019 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.367358 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.367684 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.368016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.368338 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.368679 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.369029 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.369366 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.369702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.370038 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.370354 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.370668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.371252 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.371401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.371799 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.372010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.372435 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.372638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.372957 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.373294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.373590 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.373902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.374244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.374560 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.374873 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.375185 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.375497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.375811 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.375905 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_db.sqlalchemy.engines [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.376134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.376460 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.376756 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.377067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.377378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.377691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.378019 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.378363 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.378703 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.379028 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.379357 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.379676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.380003 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.380417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.380751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.381580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.381908 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.382253 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.382593 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.382911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.383237 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.383560 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.383880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.384198 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.384521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.384860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.385194 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.385507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.385838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.386191 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.386521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.386847 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.387166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.387504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.387824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.388142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.388466 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.388783 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.389102 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.389426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.389748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.390103 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.390438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.390768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.391101 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.391458 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.391778 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.392131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.392468 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.392787 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.393107 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.393417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 26 14:09:24.393668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 26 14:09:24.416558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_db.sqlalchemy.engines [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.441124 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.context [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),369c8e97-82c0-45fb-9c79-9f2a76ac131a(cell1) {{(pid=117600) load_cells /opt/stack/nova/nova/context.py:464}} Apr 26 14:09:24.445410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:09:24.447018 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:09:24.447830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:09:24.449781 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:09:24.461174 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_db.sqlalchemy.engines [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.462053 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_db.sqlalchemy.engines [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.483627 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.context [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),369c8e97-82c0-45fb-9c79-9f2a76ac131a(cell1) {{(pid=117601) load_cells /opt/stack/nova/nova/context.py:464}} Apr 26 14:09:24.488108 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:09:24.490270 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:09:24.491217 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:09:24.493175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:09:24.507791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_db.sqlalchemy.engines [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.508640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_db.sqlalchemy.engines [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.620494 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_db.sqlalchemy.engines [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:24.668629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_db.sqlalchemy.engines [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 26 14:09:25.051572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: WARNING keystonemiddleware.auth_token [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:09:25.058161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: WARNING keystonemiddleware.auth_token [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:09:25.103639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: WARNING keystonemiddleware.auth_token [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:09:25.110155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: WARNING keystonemiddleware.auth_token [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:09:25.278840 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: WARNING keystonemiddleware.auth_token [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:09:25.283920 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: WARNING keystonemiddleware.auth_token [None req-202d1211-932f-4350-aaed-ad7e673d12f0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:09:25.290129 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd222ef9c0 pid: 117600 (default app) Apr 26 14:09:25.334292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: WARNING keystonemiddleware.auth_token [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 26 14:09:25.339491 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: WARNING keystonemiddleware.auth_token [None req-ce73abfa-ec65-4050-bc6f-d03178798a42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 26 14:09:25.344870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cd222ef9c0 pid: 117601 (default app) Apr 26 14:10:10.668650 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ea2d0df6-635e-48a1-818c-f7b8289898ce tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Action: 'create', calling method: .version_select at 0x7f406cb1e5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1444085825", "metadata": {"Type": "work"}}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:10.678058 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ea2d0df6-635e-48a1-818c-f7b8289898ce tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:10.684446 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ea2d0df6-635e-48a1-818c-f7b8289898ce tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.303384 Apr 26 14:10:10.686219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 1/1] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Apr 26 14:10:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1307 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 26 14:10:10.699127 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d915edeb-0a2e-453b-b0ed-b127db263603 tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Action: 'create', calling method: .version_select at 0x7f406cabf430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1261699174", "metadata": {"Type": "work"}}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:10.702043 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d915edeb-0a2e-453b-b0ed-b127db263603 tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:10.705831 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d915edeb-0a2e-453b-b0ed-b127db263603 tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012921 Apr 26 14:10:10.709002 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 2/2] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Apr 26 14:10:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:10:10.728606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3e696c6b-834a-4f95-a366-50579d2b673f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Action: 'create', calling method: .version_select at 0x7f406cb1eaf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-305540741", "metadata": {"Type": "work"}}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:10.730955 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3e696c6b-834a-4f95-a366-50579d2b673f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:10.731973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3e696c6b-834a-4f95-a366-50579d2b673f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010319 Apr 26 14:10:10.732989 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 3/3] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Apr 26 14:10:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:10:10.743996 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-295e98ae-d4cd-4efd-9936-9f5d031e806f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Calling method '.version_select at 0x7f406ca8a160>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:10.983964 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1c92b279-6847-4ac2-aa65-aafbfc4d8240 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Action: 'create', calling method: .version_select at 0x7f406cb1d5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-62435162", "metadata": {"Type": "work"}}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:11.557411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-295e98ae-d4cd-4efd-9936-9f5d031e806f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] HTTP exception thrown: Volume tempest-invalid-1444460207 could not be found. Apr 26 14:10:11.558872 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-295e98ae-d4cd-4efd-9936-9f5d031e806f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Returning 404 to user: Volume tempest-invalid-1444460207 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:11.560013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-295e98ae-d4cd-4efd-9936-9f5d031e806f tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1444460207" status: 404 len: 99 microversion: 2.1 time: 0.821490 Apr 26 14:10:11.568973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 4/4] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Apr 26 14:10:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1444460207 => generated 99 bytes in 831 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 26 14:10:11.576046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-902a699f-f05c-484d-8894-810c163689f3 tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005709 Apr 26 14:10:11.588527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 5/5] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Apr 26 14:10:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 26 14:10:11.601161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-966cf305-3753-4bd0-8a64-be46aa658fde tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009967 Apr 26 14:10:11.604824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 6/6] 10.222.0.23 () {58 vars in 1136 bytes} [Tue Apr 26 14:10:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 26 14:10:11.616151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6bb1e6e1-39dd-40a5-8c15-88ee88be9cff tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Calling method '.version_select at 0x7f406ca0ba60>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:11.805305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-6bb1e6e1-39dd-40a5-8c15-88ee88be9cff tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] HTTP exception thrown: Volume 5630bdd8-4dd5-4926-a4cc-ff3e68dbde16 could not be found. Apr 26 14:10:11.807069 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6bb1e6e1-39dd-40a5-8c15-88ee88be9cff tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Returning 404 to user: Volume 5630bdd8-4dd5-4926-a4cc-ff3e68dbde16 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:11.808508 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6bb1e6e1-39dd-40a5-8c15-88ee88be9cff tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/5630bdd8-4dd5-4926-a4cc-ff3e68dbde16" status: 404 len: 109 microversion: 2.1 time: 0.196764 Apr 26 14:10:11.818146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 7/7] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:10:11 2022] DELETE /compute/v2.1/os-volumes/5630bdd8-4dd5-4926-a4cc-ff3e68dbde16 => generated 109 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:10:11.823576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-897b3ad5-46f8-48d9-99d2-d7a1dea580ed tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Calling method '.version_select at 0x7f406ca0bb80>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:12.211869 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-897b3ad5-46f8-48d9-99d2-d7a1dea580ed tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] HTTP exception thrown: Volume 5524ebe1-61db-408e-9ef1-c414a4c53b1c could not be found. Apr 26 14:10:12.212536 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-897b3ad5-46f8-48d9-99d2-d7a1dea580ed tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] Returning 404 to user: Volume 5524ebe1-61db-408e-9ef1-c414a4c53b1c could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:12.213638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-897b3ad5-46f8-48d9-99d2-d7a1dea580ed tempest-VolumesNegativeTest-178587758 tempest-VolumesNegativeTest-178587758-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5524ebe1-61db-408e-9ef1-c414a4c53b1c" status: 404 len: 109 microversion: 2.1 time: 0.394363 Apr 26 14:10:12.214606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 8/8] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:11 2022] GET /compute/v2.1/os-volumes/5524ebe1-61db-408e-9ef1-c414a4c53b1c => generated 109 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:10:12.327698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1905064648", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "networks": [{"uuid": "31e9d2ec-cfa2-41cc-9e12-7e041433107c"}]}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:12.588650 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] validate_networks() for [('31e9d2ec-cfa2-41cc-9e12-7e041433107c', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:10:13.027994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1c92b279-6847-4ac2-aa65-aafbfc4d8240 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 3.338041 Apr 26 14:10:13.027994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 1/9] 10.222.0.23 () {60 vars in 1155 bytes} [Tue Apr 26 14:10:09 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 3341 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 26 14:10:13.036713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fbd7c704-f2cd-4d0f-a5f1-22758d98eb2c tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c9d95e0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:13.146156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fbd7c704-f2cd-4d0f-a5f1-22758d98eb2c tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 200 len: 351 microversion: 2.1 time: 0.114362 Apr 26 14:10:13.146718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 2/10] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:13 2022] GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:10:13.938791 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:10:13.939865 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:10:13.940605 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:10:13.941800 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:10:13.942389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:10:13.957883 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:13.958621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:13.959729 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:13.960168 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:14.019748 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Getting quotas for project 3d8a12641de140b68d42fda0758a97ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:10:14.057427 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Getting quotas for user 6c8c139c181344259612105edd7d207d and project 3d8a12641de140b68d42fda0758a97ef. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:10:14.106311 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:10:14.109262 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:10:14.159761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-90039184-f005-42e9-9e4b-7f651fcba765 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c9d9790>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:14.300169 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-90039184-f005-42e9-9e4b-7f651fcba765 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 200 len: 351 microversion: 2.1 time: 0.144603 Apr 26 14:10:14.301045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 3/11] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:14 2022] GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:14.339383 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7306bfd9-f839-4d6e-a605-9658eb3f30f3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123554 Apr 26 14:10:14.341947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 9/12] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:10:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:10:14.356611 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-73480de1-8b47-4056-8c8b-93e715074275 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:14.357601 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-73480de1-8b47-4056-8c8b-93e715074275 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:14.651417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-73480de1-8b47-4056-8c8b-93e715074275 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:14.683689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-73480de1-8b47-4056-8c8b-93e715074275 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1215 microversion: 2.1 time: 0.332110 Apr 26 14:10:14.684274 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 4/13] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:14 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1215 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:15.426903 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3cdbdf6a-7ff1-48f7-add9-cf6a6f39ea04 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c0940d0>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:15.426903 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3cdbdf6a-7ff1-48f7-add9-cf6a6f39ea04 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 200 len: 352 microversion: 2.1 time: 0.110173 Apr 26 14:10:15.458412 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 10/14] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:15 2022] GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:15.459763 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8fb8de8c-5a5c-4cd0-b408-5415073b9898 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c9bdee0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:15.563712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8fb8de8c-5a5c-4cd0-b408-5415073b9898 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 200 len: 352 microversion: 2.1 time: 0.129569 Apr 26 14:10:15.563712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 5/15] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:15 2022] GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:15.574328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-94a7e884-c264-43dc-ae69-da79876e9a50 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c8feee0>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:15.702950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9ec83a1a-581d-40f6-ac2e-8040c5d722b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:15.704080 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9ec83a1a-581d-40f6-ac2e-8040c5d722b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:15.837395 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ec83a1a-581d-40f6-ac2e-8040c5d722b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:15.848692 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9ec83a1a-581d-40f6-ac2e-8040c5d722b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1215 microversion: 2.1 time: 0.149294 Apr 26 14:10:15.852916 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 6/16] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:15 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1215 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:15.885870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-94a7e884-c264-43dc-ae69-da79876e9a50 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 202 len: 0 microversion: 2.1 time: 0.317125 Apr 26 14:10:15.887222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 11/17] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:10:15 2022] DELETE /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:10:15.899523 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ea2fee84-b9a4-411f-82a4-606bb31b8846 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c9cddc0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:16.063009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ea2fee84-b9a4-411f-82a4-606bb31b8846 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 200 len: 351 microversion: 2.1 time: 0.169993 Apr 26 14:10:16.069302 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 7/18] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:15 2022] GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 351 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:16.871684 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3c8e1870-4858-44a2-9744-415fc0a1a204 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:16.872663 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3c8e1870-4858-44a2-9744-415fc0a1a204 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:17.043337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3c8e1870-4858-44a2-9744-415fc0a1a204 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:17.077278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6e81c7b4-031a-401d-b40b-002ad34c9c82 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Calling method '.version_select at 0x7f406c9cd430>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:17.093577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3c8e1870-4858-44a2-9744-415fc0a1a204 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1215 microversion: 2.1 time: 0.228146 Apr 26 14:10:17.094214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 12/19] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:16 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:17.113303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-6e81c7b4-031a-401d-b40b-002ad34c9c82 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] HTTP exception thrown: Volume b2a0b0f5-c157-4a4d-820c-15900aa380c6 could not be found. Apr 26 14:10:17.114281 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6e81c7b4-031a-401d-b40b-002ad34c9c82 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] Returning 404 to user: Volume b2a0b0f5-c157-4a4d-820c-15900aa380c6 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:10:17.115288 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6e81c7b4-031a-401d-b40b-002ad34c9c82 tempest-VolumesGetTestJSON-1143409590 tempest-VolumesGetTestJSON-1143409590-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6" status: 404 len: 109 microversion: 2.1 time: 0.042536 Apr 26 14:10:17.116042 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 8/20] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:17 2022] GET /compute/v2.1/os-volumes/b2a0b0f5-c157-4a4d-820c-15900aa380c6 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:10:18.110928 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:18.111556 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:18.129806 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:18.130299 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:18.131115 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:18.131562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:18.545036 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:18.567099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4ded7fdb-cbe9-45d8-a0f7-d0ab5905f1b9 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1211 microversion: 2.1 time: 0.460038 Apr 26 14:10:18.569903 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 13/21] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:18 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1211 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:19.588450 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:19.590082 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:19.606910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:19.607970 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:19.609282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:19.610047 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:20.029650 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:20.047160 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-44db33cf-9af0-4aed-8ee8-742bcd9642ee tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1273 microversion: 2.1 time: 0.463953 Apr 26 14:10:20.047969 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 9/22] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:19 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1273 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:21.081786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:21.082461 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:21.089722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:21.095427 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:21.097820 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:21.103830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:21.603653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-353733482", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:21.822630 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] validate_networks() for [('2f88888a-dab3-44ae-957f-4a304598e58f', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:10:22.061778 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:22.073844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d81ef90a-2fa3-469b-8c30-bf20a08f3d84 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1273 microversion: 2.1 time: 1.005395 Apr 26 14:10:22.084825 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 14/23] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:21 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1273 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:23.094248 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:23.095974 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:23.115245 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:23.116363 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:23.119838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:23.122773 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:23.341072 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:23.354591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-63fd6718-d17e-4c40-9657-a25ba3688900 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1273 microversion: 2.1 time: 0.266016 Apr 26 14:10:23.368318 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 15/24] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:23 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1273 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:24.324761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6f01ca77-9612-478f-8dee-c941947a96e5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: .version_select at 0x7f40677fb4c0>, body: {"keypair": {"name": "tempest-keypair-2132774537"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:24.386544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6f01ca77-9612-478f-8dee-c941947a96e5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:10:24.396710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6f01ca77-9612-478f-8dee-c941947a96e5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for user 5adf6fccb73242bab32c2fdf0ea23ff3 and project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:10:25.214101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6f01ca77-9612-478f-8dee-c941947a96e5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:10:25.225560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6f01ca77-9612-478f-8dee-c941947a96e5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for user 5adf6fccb73242bab32c2fdf0ea23ff3 and project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:10:25.245306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6f01ca77-9612-478f-8dee-c941947a96e5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.879089 Apr 26 14:10:25.246334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 16/25] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:10:23 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:25.260857 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:25.267856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:25.304789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:25.305329 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:25.306229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:25.307162 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:26.253693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:10:26.254302 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:10:26.254734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:10:26.255145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:10:26.256349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:10:26.310059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:26.313647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:26.313647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:26.330617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:26.399540 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:10:26.416991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for user 706ce393383a460b9b5857f74224a1fa and project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:10:26.471840 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:10:26.475679 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:10:26.756122 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-00345dbd-4b8b-4a41-8d26-ec6e188e0b98 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.681594 Apr 26 14:10:26.757368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 10/26] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:10:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 5684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:10:26.767826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3a7b45b3-52a8-4b93-9e4b-1b539590bf42 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f4067fd1ca0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:26.887789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3a7b45b3-52a8-4b93-9e4b-1b539590bf42 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/f6894380-e902-44fb-a545-c6ebcdae6ed3" status: 200 len: 350 microversion: 2.1 time: 0.128890 Apr 26 14:10:26.889907 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 11/27] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:26 2022] GET /compute/v2.1/os-volumes/f6894380-e902-44fb-a545-c6ebcdae6ed3 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:26.896841 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-98f3885a-7d83-43ad-9f32-99e8b6f48ac5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:26.897787 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-98f3885a-7d83-43ad-9f32-99e8b6f48ac5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:27.144262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-98f3885a-7d83-43ad-9f32-99e8b6f48ac5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:27.155549 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-98f3885a-7d83-43ad-9f32-99e8b6f48ac5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1221 microversion: 2.1 time: 0.261865 Apr 26 14:10:27.158466 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 12/28] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:26 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1221 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:27.466445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1877359873", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:27.607905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] validate_networks() for [('2f88888a-dab3-44ae-957f-4a304598e58f', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:10:27.675193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:27.735981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-58c44828-5d49-420e-8a08-08f07d617522 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 2.488279 Apr 26 14:10:27.737650 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 17/29] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:25 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 2491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:28.770465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:28.770465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:28.793768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:28.797188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:28.797188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:28.797188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:28.994226 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:10:28.995554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:10:28.996239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:10:28.997170 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:10:28.998417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:10:29.020538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:29.023043 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:29.023043 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:29.025730 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:29.076480 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:10:29.085593 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for user 706ce393383a460b9b5857f74224a1fa and project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:10:29.139221 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:10:29.142471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:10:29.419639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a5a5b8e8-78c9-44fe-a81d-47c5dcca5fd1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.930563 Apr 26 14:10:29.426167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 13/30] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:10:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:10:29.446110 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9581553c-c22d-4205-b9d1-c6787d6c4504 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f4067ff5dc0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:29.595575 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9581553c-c22d-4205-b9d1-c6787d6c4504 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/4964a12a-60d0-450e-8870-5541b067a999" status: 200 len: 350 microversion: 2.1 time: 0.167186 Apr 26 14:10:29.601995 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 14/31] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:29 2022] GET /compute/v2.1/os-volumes/4964a12a-60d0-450e-8870-5541b067a999 => generated 350 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:29.607257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-badc334a-9bcd-4c0d-8206-e1d3c982cc76 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:29.607908 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-badc334a-9bcd-4c0d-8206-e1d3c982cc76 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:29.642895 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:29.656935 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-083575ca-c901-40cc-8411-d0ee92c6c5fa tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.905579 Apr 26 14:10:29.671565 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 18/32] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:28 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:29.825049 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-badc334a-9bcd-4c0d-8206-e1d3c982cc76 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:29.832147 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-badc334a-9bcd-4c0d-8206-e1d3c982cc76 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1222 microversion: 2.1 time: 0.233225 Apr 26 14:10:29.845085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 15/33] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:29 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1222 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:30.678504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:30.679378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:30.717696 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:30.718189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:30.722721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:30.723125 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:30.856784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-0fe85cf4-6dbe-4d66-9275-4225d647e70f req-e2f1f615-6e82-40ce-bc3e-b6158488108e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273cc945-5e47-4750-931a-a753cceef77a", "tag": "deabb5f0-90be-4df9-8257-aa30c4322106"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:30.962276 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0fe85cf4-6dbe-4d66-9275-4225d647e70f req-e2f1f615-6e82-40ce-bc3e-b6158488108e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:30.981128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0fe85cf4-6dbe-4d66-9275-4225d647e70f req-e2f1f615-6e82-40ce-bc3e-b6158488108e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:31.087808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-0fe85cf4-6dbe-4d66-9275-4225d647e70f req-e2f1f615-6e82-40ce-bc3e-b6158488108e service nova] Creating event network-changed:deabb5f0-90be-4df9-8257-aa30c4322106 for instance 273cc945-5e47-4750-931a-a753cceef77a on hv-cinder-83513 Apr 26 14:10:31.094988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0fe85cf4-6dbe-4d66-9275-4225d647e70f req-e2f1f615-6e82-40ce-bc3e-b6158488108e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117600) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 26 14:10:31.106374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:31.110272 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:31.118137 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:31.120577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:31.169671 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.compute.rpcapi [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 26 14:10:31.173587 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] Releasing lock "compute-rpcapi-router" {{(pid=117600) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 26 14:10:31.233240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-081edc2e-9bf0-45cf-afd1-5b244566e6b8 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.737486 Apr 26 14:10:31.245059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 19/34] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:31.275478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:31.276577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:31.327921 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:31.328393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:31.342961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:31.343483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:31.710782 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:31.724992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d904f46e-bbd0-49ba-9948-eaa5cb8e10e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1226 microversion: 2.1 time: 0.481742 Apr 26 14:10:31.733809 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 20/35] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:31 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1226 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:31.999013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:32.011095 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8d802a5c-46ff-496f-9a6a-64464ee2eacb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 1.337977 Apr 26 14:10:32.012074 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 16/36] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:30 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:32.038457 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e2f0bd02-48fc-41f6-8abb-f15bf2181b85 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f4067794040>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:32.156000 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e2f0bd02-48fc-41f6-8abb-f15bf2181b85 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/a538a6b7-8ac9-439d-8ada-597fd5b2d83d" status: 200 len: 350 microversion: 2.1 time: 0.123297 Apr 26 14:10:32.173759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 21/37] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:10:32 2022] GET /compute/v2.1/os-volumes/a538a6b7-8ac9-439d-8ada-597fd5b2d83d => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:32.176374 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d1a4bcee-c6ad-43af-8670-701e9fb0d0d8 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f4067ff5f70>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:32.334016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d1a4bcee-c6ad-43af-8670-701e9fb0d0d8 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.168185 Apr 26 14:10:32.334564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 17/38] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Apr 26 14:10:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:32.358099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6c75a868-acc2-4526-a870-2ba6fa6f54cf tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f4067794310>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:32.594289 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6c75a868-acc2-4526-a870-2ba6fa6f54cf tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.250074 Apr 26 14:10:32.599086 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 22/39] 10.222.0.23 () {58 vars in 1148 bytes} [Tue Apr 26 14:10:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:32.607821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-10e3eba0-6450-4821-a646-aeef60f09723 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f4067fd1c10>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:32.753306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:32.753306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:32.782592 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:32.783366 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:32.806245 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-10e3eba0-6450-4821-a646-aeef60f09723 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.202907 Apr 26 14:10:32.807399 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 18/40] 10.222.0.23 () {58 vars in 1133 bytes} [Tue Apr 26 14:10:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:32.816929 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:32.819960 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-375b5b87-9ddb-406d-bdec-33addacc9cb5 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f406778c940>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:32.821959 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:33.125345 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:33.141234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-91fd0723-ce1d-45b3-9f56-c8c634934687 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1282 microversion: 2.1 time: 0.390157 Apr 26 14:10:33.152339 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 23/41] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:32 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1282 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:33.157193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:33.163786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:33.181012 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:33.182860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:33.184369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:33.194562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:33.535459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-375b5b87-9ddb-406d-bdec-33addacc9cb5 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.720074 Apr 26 14:10:33.546048 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 19/42] 10.222.0.23 () {58 vars in 1166 bytes} [Tue Apr 26 14:10:32 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:10:33.556331 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-29c762bd-3a38-46cd-8c4c-4bc6657c72d0 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f406778cee0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:33.841580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-29c762bd-3a38-46cd-8c4c-4bc6657c72d0 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.279420 Apr 26 14:10:33.841580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 20/43] 10.222.0.23 () {58 vars in 1169 bytes} [Tue Apr 26 14:10:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:10:33.847769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1aa1807e-610c-4895-906d-074463647537 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f406778c3a0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:33.956463 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:33.965003 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1aa1807e-610c-4895-906d-074463647537 tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.121979 Apr 26 14:10:33.966392 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 21/44] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Apr 26 14:10:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:33.972480 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c34187f7-f7fb-4dab-a210-1ba93661a4cc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.827589 Apr 26 14:10:33.973578 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 24/45] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:33 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:33.986193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9299c904-e6d1-49b7-8684-90408b77e40c tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f406778c310>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:34.084223 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9299c904-e6d1-49b7-8684-90408b77e40c tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.110099 Apr 26 14:10:34.085085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 22/46] 10.222.0.23 () {58 vars in 1187 bytes} [Tue Apr 26 14:10:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:34.101201 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-618d4966-fcb1-43bc-9ce4-c0401280214e tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] Calling method '.version_select at 0x7f406d3bab80>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:34.122131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-603777015", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da497052-bded-497c-b389-e8193210a8cf"}], "security_groups": [{"name": "tempest-securitygroup--2026998090"}], "key_name": "tempest-keypair-2132774537", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:34.342234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-618d4966-fcb1-43bc-9ce4-c0401280214e tempest-VolumesTestJSON-918914219 tempest-VolumesTestJSON-918914219-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.247048 Apr 26 14:10:34.344147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 25/47] 10.222.0.23 () {58 vars in 1154 bytes} [Tue Apr 26 14:10:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:34.358701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:34.362696 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:34.379387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:34.383481 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:34.389402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:34.391113 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:34.473154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] validate_networks() for [('da497052-bded-497c-b389-e8193210a8cf', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:10:34.536230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:34.552261 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-33219dd4-4a64-4e31-b320-45ac9e3cc9aa tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1280 microversion: 2.1 time: 0.205966 Apr 26 14:10:34.559542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 26/48] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:34 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:34.993519 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:34.994184 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:35.007852 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:35.008322 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:35.009133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:35.009582 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:35.435358 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:10:35.435923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:10:35.436269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:10:35.436680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:10:35.440655 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:10:35.463573 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:35.464232 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:35.466954 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:35.467786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:35.489106 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:10:35.493631 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for user 5adf6fccb73242bab32c2fdf0ea23ff3 and project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:10:35.508958 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:10:35.511733 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:10:35.689930 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-cd66cfa3-7758-4659-b88f-1e8e0419e249 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.571759 Apr 26 14:10:35.698517 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 23/49] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:10:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 1581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:10:35.710627 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:35.712100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:35.723218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:35.723891 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:35.727514 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:35.728460 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:35.836256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:35.838905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e7853e76-72fa-4703-9bee-90c7f77ae1e1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1280 microversion: 2.1 time: 0.137906 Apr 26 14:10:35.840513 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 24/50] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:35 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1280 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:35.846697 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6b1e5071-d131-459d-a171-73f6e1a8685c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:35.847581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6b1e5071-d131-459d-a171-73f6e1a8685c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:35.858631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:35.874461 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7552f6ba-6a32-4ccd-8f8f-997cbb409b9c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.883146 Apr 26 14:10:35.878126 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 27/51] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:34 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:35.967649 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6b1e5071-d131-459d-a171-73f6e1a8685c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:35.975983 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6b1e5071-d131-459d-a171-73f6e1a8685c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1237 microversion: 2.1 time: 0.133976 Apr 26 14:10:35.977508 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 25/52] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:35 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1237 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:36.867576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:36.868722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:36.876425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:36.877057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:36.878597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:36.879258 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:36.901761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:36.903581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:36.913224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:36.914241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:36.915698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:36.916450 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:37.145818 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:37.154440 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8de06bab-eb7f-42bf-91c6-3092ba8d4a0f tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.260803 Apr 26 14:10:37.155612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 26/53] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:36 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:37.160848 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:37.161610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:37.169199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:37.170078 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:37.170877 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:37.171474 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:37.238112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:37.252506 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3cfac9aa-618d-4ecd-9930-37b6ac81b96e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.394739 Apr 26 14:10:37.253725 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 28/54] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:36 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:37.258892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-cbfaa63c-5b84-4022-8c81-dbbd2286b977 req-6c404ed3-2714-4d7d-a576-4a96f3f886e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8", "tag": "929beb4c-1416-4cbb-a27f-30e55ee70ab6"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:37.268958 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-cbfaa63c-5b84-4022-8c81-dbbd2286b977 req-6c404ed3-2714-4d7d-a576-4a96f3f886e4 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:37.269737 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-cbfaa63c-5b84-4022-8c81-dbbd2286b977 req-6c404ed3-2714-4d7d-a576-4a96f3f886e4 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:37.273214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:37.280061 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5af2e017-11a6-4eb2-aa7a-a33ac9cf52df tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1241 microversion: 2.1 time: 0.123120 Apr 26 14:10:37.284383 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-cbfaa63c-5b84-4022-8c81-dbbd2286b977 req-6c404ed3-2714-4d7d-a576-4a96f3f886e4 service nova] Creating event network-changed:929beb4c-1416-4cbb-a27f-30e55ee70ab6 for instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 on hv-cinder-83513 Apr 26 14:10:37.291407 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 27/55] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:37 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:37.293487 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-cbfaa63c-5b84-4022-8c81-dbbd2286b977 req-6c404ed3-2714-4d7d-a576-4a96f3f886e4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038063 Apr 26 14:10:37.294380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 29/56] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:38.185702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:38.187588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:38.203726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:38.215316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:38.216526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:38.218620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:38.270762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:38.271974 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:38.296910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:38.297386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:38.298272 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:38.298714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:38.454483 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:38.465113 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1402f59f-fa7f-4b9c-87ef-6c4dd469d7bf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.296645 Apr 26 14:10:38.466353 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 28/57] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:38 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:38.472350 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:38.473406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:38.485643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:38.485643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:38.485643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:38.485643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:38.566983 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:38.580267 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b56ef9c2-5c41-4f10-9d3e-361eecd0b960 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1297 microversion: 2.1 time: 0.112527 Apr 26 14:10:38.593595 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 29/58] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:38 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:38.949533 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:38.972722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-34749b29-7829-4cff-9c7a-9b559fbb4d78 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.706401 Apr 26 14:10:38.978188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 30/59] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:38 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:39.343621 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-9ee04be4-ad5e-4b47-aa8c-8511f9b3c964 req-e9c57086-bcb9-46cf-a22c-080dfa019ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5c588d0-aa8c-4db6-aba6-ff2863b26ad7", "tag": "0e992724-8bbd-4a49-96d5-fa786b2405ab"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:39.388217 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-9ee04be4-ad5e-4b47-aa8c-8511f9b3c964 req-e9c57086-bcb9-46cf-a22c-080dfa019ef0 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.390409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-9ee04be4-ad5e-4b47-aa8c-8511f9b3c964 req-e9c57086-bcb9-46cf-a22c-080dfa019ef0 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.429438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-9ee04be4-ad5e-4b47-aa8c-8511f9b3c964 req-e9c57086-bcb9-46cf-a22c-080dfa019ef0 service nova] Creating event network-changed:0e992724-8bbd-4a49-96d5-fa786b2405ab for instance b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 on hv-cinder-83513 Apr 26 14:10:39.436698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-9ee04be4-ad5e-4b47-aa8c-8511f9b3c964 req-e9c57086-bcb9-46cf-a22c-080dfa019ef0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117601) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 26 14:10:39.441220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.442961 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.447279 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.450267 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.469785 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.compute.rpcapi [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 26 14:10:39.469785 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117601) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 26 14:10:39.483151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:39.483926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:39.488796 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4c2d3451-c2d7-467d-aa9c-8ad7a7581eb9 None None] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148941 Apr 26 14:10:39.490642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.491558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 30/60] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:39.491662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.492102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.492554 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.607687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:39.608428 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:39.615087 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.615546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.616339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:39.616784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:39.737809 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:39.749422 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1acb2394-2734-4c2b-827e-69015b4ff036 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1295 microversion: 2.1 time: 0.145840 Apr 26 14:10:39.754047 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 31/61] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:39 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1295 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:39.791522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:39.799259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-358dfd57-ab02-4baf-9d1d-a27524fb7200 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.320125 Apr 26 14:10:39.800411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 31/62] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:39 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:39.998294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:39.999112 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:40.017484 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:40.017981 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:40.020457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:40.020865 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:40.328078 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:40.355310 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1b9c11a0-446e-46d6-a8c4-56e1567ea959 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.370121 Apr 26 14:10:40.357469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 32/63] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:39 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:40.772624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:40.772624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:40.778312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:40.778849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:40.779768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:40.780278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:40.817625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:40.818800 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:40.836737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:40.838164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:40.840961 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:40.842232 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:41.051999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:41.061448 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-99a101ea-a022-460e-a717-aa7135b3a64a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.248526 Apr 26 14:10:41.072510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 33/64] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:40 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:41.116353 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:41.138276 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2ebce2f0-4a8c-4d1b-bdc5-65307a0a1962 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.370276 Apr 26 14:10:41.144081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 32/65] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:40 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:41.375739 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:41.376453 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:41.384168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:41.384807 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:41.389088 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:41.389712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:41.571419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:41.582659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b9f95ad3-25d0-43b5-bd24-9596ca2878ee tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.209946 Apr 26 14:10:41.583303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 34/66] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:41 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:41.943531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-bd8aca71-21b0-45a8-8a50-14cbc5ab9210 req-40c275a1-1013-4eee-8e6f-d249cc34e0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feac5dcc-29a9-415d-9898-564338c394d0", "tag": "ca1854d6-548d-485b-8cbc-1f2457d13483"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:41.951760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-bd8aca71-21b0-45a8-8a50-14cbc5ab9210 req-40c275a1-1013-4eee-8e6f-d249cc34e0d6 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:41.952577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-bd8aca71-21b0-45a8-8a50-14cbc5ab9210 req-40c275a1-1013-4eee-8e6f-d249cc34e0d6 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:41.965216 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-bd8aca71-21b0-45a8-8a50-14cbc5ab9210 req-40c275a1-1013-4eee-8e6f-d249cc34e0d6 service nova] Creating event network-changed:ca1854d6-548d-485b-8cbc-1f2457d13483 for instance feac5dcc-29a9-415d-9898-564338c394d0 on hv-cinder-83513 Apr 26 14:10:41.977066 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-bd8aca71-21b0-45a8-8a50-14cbc5ab9210 req-40c275a1-1013-4eee-8e6f-d249cc34e0d6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037573 Apr 26 14:10:41.978340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 33/67] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:10:42.078741 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:42.079349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:42.085491 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:42.085941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:42.086735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:42.087168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:42.160673 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:42.161642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:42.168493 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:42.168945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:42.169716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:42.170179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:42.238489 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:42.246930 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5ee793da-8a9a-4cd8-ad5d-fd130047849a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.172243 Apr 26 14:10:42.247601 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 35/68] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:42 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:42.330163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:42.337772 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ee007058-e5c8-4345-8828-0137d881c69e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.183531 Apr 26 14:10:42.338375 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 34/69] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:42 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:42.600616 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:42.601388 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:42.608438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:42.608935 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:42.609719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:42.610188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:42.795214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:42.804773 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0f2d9b3e-19c6-49ad-b1a2-6f6644188dc5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.209679 Apr 26 14:10:42.806489 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 36/70] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:42 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:43.264725 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:43.265377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:43.271479 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:43.272306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:43.274231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:43.274231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:43.354871 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:43.355481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:43.363793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:43.369579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:43.369579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:43.369579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:43.483939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:43.498923 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-899362dd-44fe-462f-abef-5483b3caa6c7 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.238155 Apr 26 14:10:43.499704 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 35/71] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:43 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:43.547467 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:43.555808 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5eb6062d-8cc6-4e9b-acd1-eedeb0035af2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.205030 Apr 26 14:10:43.556483 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 37/72] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:43 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:43.823206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:43.823814 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:43.829671 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:43.830162 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:43.831730 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:43.832156 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:43.985341 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:43.992981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2ab3433c-fde5-4418-b962-e753095693bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.173619 Apr 26 14:10:43.993574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 36/73] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:43 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:44.524846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:44.526589 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:44.535704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:44.536704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:44.538094 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:44.538968 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:44.573237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:44.574922 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:44.584956 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:44.585935 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:44.588268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:44.590171 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:44.799967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:44.809257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ba835456-5bdc-4d51-acaf-00220201aea4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.289044 Apr 26 14:10:44.820140 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 38/74] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:44 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:44.884142 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:44.892067 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4e4978b4-86fb-41d7-a98c-f50acaec66cc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.323169 Apr 26 14:10:44.893719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 37/75] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:44 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:45.010434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:45.011049 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:45.016967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:45.017417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:45.018796 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:45.019398 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:45.160610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:45.169023 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6e5aff3b-f74c-4a25-9a98-90cced1ef218 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.162388 Apr 26 14:10:45.169763 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 39/76] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:45 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:45.827220 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:45.827839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:45.833879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:45.834359 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:45.835126 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:45.835561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:45.910891 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:45.912164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:45.920288 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:45.921336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:45.922453 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:45.924241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:45.992852 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:46.000678 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3ed2e339-be9a-47ab-ba50-90810a0d5b37 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.177411 Apr 26 14:10:46.001252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 38/77] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:45 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:46.066465 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:46.074439 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-82917716-3e1f-4af7-ade6-66066cbd0b69 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.168250 Apr 26 14:10:46.075004 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 40/78] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:45 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:46.193960 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:46.194942 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:46.200833 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:46.201361 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:46.202445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:46.202762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:46.359761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:46.367880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c7f1cf72-9076-45ad-b58d-942e08c8ff9c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.178298 Apr 26 14:10:46.368489 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 39/79] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:46 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:47.016714 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:47.017334 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:47.024000 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.024447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.025231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.025670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.091912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:47.092567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:47.098527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.098985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.099813 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.100212 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.212297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:47.221769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d4cf5900-6738-41ed-aef3-5c7f1ea02eea tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.208946 Apr 26 14:10:47.231740 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 41/80] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:47 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:47.262150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:47.272215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6121cf67-3a13-4544-a671-da94d3399af8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.184132 Apr 26 14:10:47.273036 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 40/81] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:47 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:47.384553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:47.385163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:47.395108 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.396012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.399027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.399807 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.547009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:47.555092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6fa893d2-56f8-41de-aa93-9b1f92a92f33 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.174449 Apr 26 14:10:47.555674 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 42/82] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:47 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:47.813910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-d0a7d8d0-8e76-42fc-832d-b45e688c83f6 req-e1854206-4568-4b75-9963-32dee7d7b023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8", "name": "network-vif-plugged", "status": "completed", "tag": "929beb4c-1416-4cbb-a27f-30e55ee70ab6"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:47.822345 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-d0a7d8d0-8e76-42fc-832d-b45e688c83f6 req-e1854206-4568-4b75-9963-32dee7d7b023 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:47.822938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-d0a7d8d0-8e76-42fc-832d-b45e688c83f6 req-e1854206-4568-4b75-9963-32dee7d7b023 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:47.834749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-d0a7d8d0-8e76-42fc-832d-b45e688c83f6 req-e1854206-4568-4b75-9963-32dee7d7b023 service nova] Creating event network-vif-plugged:929beb4c-1416-4cbb-a27f-30e55ee70ab6 for instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 on hv-cinder-83513 Apr 26 14:10:47.840074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-d0a7d8d0-8e76-42fc-832d-b45e688c83f6 req-e1854206-4568-4b75-9963-32dee7d7b023 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089393 Apr 26 14:10:47.840668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 41/83] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:48.239082 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:48.239696 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:48.245978 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:48.246446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:48.247230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:48.247672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:48.291959 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:48.293747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:48.301359 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:48.301938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:48.302850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:48.303649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:48.404991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:48.413494 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-760e7301-4a74-4bf5-aecc-63d2c1150372 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.178812 Apr 26 14:10:48.418009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 43/84] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:48 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:48.469403 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:48.477789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5be37da8-6ef0-4213-8c29-b011e816a96d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.191362 Apr 26 14:10:48.478389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 42/85] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:48 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:48.573809 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:48.574447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:48.580923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:48.581373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:48.582167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:48.582605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:48.708603 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:48.715726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5ac0a8c7-d4af-4e37-8fe2-23d6ffc0b179 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.145724 Apr 26 14:10:48.716292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 44/86] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:48 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:49.430086 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:49.435522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:49.436647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.437099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.437871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.438343 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.494657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:49.495368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:49.501231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.501782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.503151 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.503584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.569795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:49.578620 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5d65e427-797b-4e5b-b869-732d2878348a tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.152344 Apr 26 14:10:49.579207 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 43/87] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:49 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:49.634921 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:49.651602 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-dfb0d6ad-f256-4df6-94e8-956a5a174c7d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.160693 Apr 26 14:10:49.652104 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 45/88] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:49 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:49.732914 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:49.733527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:49.739588 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.740044 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.740813 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.741254 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.854701 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-94ffba21-64c5-4125-8c48-c93d787e3652 req-d985a4f2-1927-4c98-a841-f162ad740c0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c588d0-aa8c-4db6-aba6-ff2863b26ad7", "name": "network-vif-plugged", "status": "completed", "tag": "0e992724-8bbd-4a49-96d5-fa786b2405ab"}, {"server_uuid": "273cc945-5e47-4750-931a-a753cceef77a", "name": "network-vif-plugged", "status": "completed", "tag": "deabb5f0-90be-4df9-8257-aa30c4322106"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:49.863974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-94ffba21-64c5-4125-8c48-c93d787e3652 req-d985a4f2-1927-4c98-a841-f162ad740c0a service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:49.864421 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-94ffba21-64c5-4125-8c48-c93d787e3652 req-d985a4f2-1927-4c98-a841-f162ad740c0a service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:49.872516 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:49.877794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-94ffba21-64c5-4125-8c48-c93d787e3652 req-d985a4f2-1927-4c98-a841-f162ad740c0a service nova] Creating event network-vif-plugged:0e992724-8bbd-4a49-96d5-fa786b2405ab for instance b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 on hv-cinder-83513 Apr 26 14:10:49.878331 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-94ffba21-64c5-4125-8c48-c93d787e3652 req-d985a4f2-1927-4c98-a841-f162ad740c0a service nova] Creating event network-vif-plugged:deabb5f0-90be-4df9-8257-aa30c4322106 for instance 273cc945-5e47-4750-931a-a753cceef77a on hv-cinder-83513 Apr 26 14:10:49.880406 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c2b42510-57bc-4807-83bf-b4fd3cd0c619 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.151317 Apr 26 14:10:49.880979 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 44/89] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:49 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:49.884750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-94ffba21-64c5-4125-8c48-c93d787e3652 req-d985a4f2-1927-4c98-a841-f162ad740c0a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033720 Apr 26 14:10:49.885328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 46/90] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:10:50.601761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:50.602881 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:50.615249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:50.615850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:50.616864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:50.617310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:50.669546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:50.671075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:50.678820 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:50.680137 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:50.680974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:50.681432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:50.823951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:50.831991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b359d88f-409e-4db7-a93d-d1107a98d0e7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.166588 Apr 26 14:10:50.832666 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 47/91] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:50 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:50.896584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:50.897205 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:50.903181 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:50.903638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:50.904415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:50.904854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:50.941695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:50.949348 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a684f1ab-ddab-4d9c-8bd6-daa0b3ebd8b0 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.355845 Apr 26 14:10:50.950049 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 45/92] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:50 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:51.047723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:51.055012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9fd52de0-66fa-42c2-9893-9424c18215a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.162379 Apr 26 14:10:51.055581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 48/93] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:50 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:51.848301 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:51.848911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:51.854665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:51.855116 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:51.855886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:51.856330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:51.966502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:51.967115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:51.972878 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:51.974887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:51.974887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:51.974887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:51.989715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:51.996910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-382e99be-df4e-4d6f-82a4-eb4d075a0f36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.152926 Apr 26 14:10:51.997563 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 46/94] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:51 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:52.071491 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:52.072093 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:52.077766 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:52.078243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:52.079010 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:52.079443 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:52.106430 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:52.114317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d099a5d7-cce6-444a-80fc-c8a097e5ec6b tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.151789 Apr 26 14:10:52.114895 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 49/95] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:51 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:52.206281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:52.213575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bc2fe513-b813-41ee-a945-75a64e75b2c4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.145695 Apr 26 14:10:52.214058 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 47/96] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:52 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:53.014905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:53.015598 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:53.024448 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:53.025225 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:53.026637 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:53.027437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:53.131685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:53.132469 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:53.138486 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:53.138940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:53.139724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:53.140167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:53.160766 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:53.168351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a74a783a-b5bc-44d9-9eea-016e926493ae tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.157809 Apr 26 14:10:53.169027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 50/97] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:53 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:53.230587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:53.231224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:53.237037 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:53.237487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:53.238283 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:53.238720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:53.354410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:53.363238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fec0dc3e-4569-4e21-90b6-fb6ed51a9eed tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.235351 Apr 26 14:10:53.364022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 48/98] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:53 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:53.381197 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:53.388912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a0c71dc8-52e5-49ea-9242-9cb01d46e283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.161968 Apr 26 14:10:53.398725 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 51/99] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:53 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:54.184664 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:54.185192 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:54.191927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:54.192383 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:54.193165 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:54.193604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:54.326925 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:54.334189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6f10ee21-2457-468a-ba79-78e45ac040dd tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.153455 Apr 26 14:10:54.334778 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 49/100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:54 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:54.380732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:54.381430 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:54.387384 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:54.387837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:54.388603 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:54.389045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:54.412507 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:54.413382 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:54.419132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:54.419583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:54.420354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:54.420795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:54.518976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:54.526336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a56a7435-4602-46ad-8fc3-52f35ef0bfbc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.149937 Apr 26 14:10:54.527125 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 52/101] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:54 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:54.552885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:54.560024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4a43b370-5296-477d-8596-9ad402f71dca tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.151355 Apr 26 14:10:54.560585 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 50/102] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:54 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:55.351146 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:55.351755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:55.357548 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:55.358009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:55.358776 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:55.359212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:55.493574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:55.500751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ebb543d4-d031-4c7e-a07b-52eb3d67df7e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.153611 Apr 26 14:10:55.501309 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 53/103] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:55 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:55.542769 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:55.543381 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:55.549802 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:55.550281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:55.551049 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:55.551484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:55.576457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:55.577075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:55.583471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:55.583925 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:55.584698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:55.585139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:55.682328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:55.690238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e8d9434d-e04d-4db5-b6a4-8bea899a26bc tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.150639 Apr 26 14:10:55.690815 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 51/104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:55 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:55.719306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:55.727235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8aebabe6-86ce-4fb6-ae7e-926e77bc0512 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.154598 Apr 26 14:10:55.727846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 54/105] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:55 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:56.446977 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-c8dbe864-3d2d-4d59-abcd-e3aa06ecc57f req-4c33f7ec-8c8a-4334-9240-76893ec342aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feac5dcc-29a9-415d-9898-564338c394d0", "name": "network-vif-plugged", "status": "completed", "tag": "ca1854d6-548d-485b-8cbc-1f2457d13483"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:10:56.455685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-c8dbe864-3d2d-4d59-abcd-e3aa06ecc57f req-4c33f7ec-8c8a-4334-9240-76893ec342aa service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.456124 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-c8dbe864-3d2d-4d59-abcd-e3aa06ecc57f req-4c33f7ec-8c8a-4334-9240-76893ec342aa service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.467337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-c8dbe864-3d2d-4d59-abcd-e3aa06ecc57f req-4c33f7ec-8c8a-4334-9240-76893ec342aa service nova] Creating event network-vif-plugged:ca1854d6-548d-485b-8cbc-1f2457d13483 for instance feac5dcc-29a9-415d-9898-564338c394d0 on hv-cinder-83513 Apr 26 14:10:56.473163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-c8dbe864-3d2d-4d59-abcd-e3aa06ecc57f req-4c33f7ec-8c8a-4334-9240-76893ec342aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032271 Apr 26 14:10:56.473919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 52/106] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:10:56.518199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:56.518826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:56.524592 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.525045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.525813 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.526286 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.662958 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:56.670304 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e4711690-7368-42f5-a41d-7087286e7241 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.156755 Apr 26 14:10:56.670885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 55/107] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:56 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:56.707545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:56.731226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:56.731226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.731226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.731226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.731591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.744616 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:56.745305 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:56.751326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.751885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.752670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:56.753115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:56.891264 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:56.891264 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8fe656e3-a8ee-43b4-b33b-2d361c2b13fe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.169169 Apr 26 14:10:56.891264 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 53/108] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:56 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:56.891688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:56.897302 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a114d1f6-f100-44a4-b81c-160041ffe047 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.156653 Apr 26 14:10:56.897862 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 56/109] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:56 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:57.687694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:57.688255 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:57.694115 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:57.694559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:57.695309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:57.695737 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:57.832391 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:57.839662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3b32d009-6c6a-42de-8a63-b31be0ad8402 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.155869 Apr 26 14:10:57.840221 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 54/110] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:57 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:57.895924 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:57.896541 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:57.902417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:57.902865 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:57.903625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:57.904061 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:57.914651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:57.915255 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:57.921077 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:57.921522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:57.922307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:57.922740 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:58.054628 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:58.062161 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c99af02d-0b43-4a03-b86b-23c526bd1345 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.170415 Apr 26 14:10:58.062736 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 57/111] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:57 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:58.070712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:58.077940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ab14f431-2732-4f32-858c-cdbdae1107af tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.167265 Apr 26 14:10:58.078659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 55/112] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:57 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:10:58.856129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:58.856750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:58.863213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:58.863665 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:58.864434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:58.865119 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:58.991415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:58.998558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0ba1b3f0-e47a-4238-b712-db3814b1f306 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.146280 Apr 26 14:10:58.999122 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 58/113] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:58 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:59.079038 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:59.080329 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:59.086183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:59.086645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:59.087411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:59.087853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:59.094855 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:10:59.095468 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:10:59.101452 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:59.101901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:59.102704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:10:59.103143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:10:59.216881 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:59.223996 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9c7b5cce-061f-4603-b0e8-f8d4999709cf tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.148711 Apr 26 14:10:59.224570 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 56/114] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:59 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:10:59.233382 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:10:59.240626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9a8d7923-ec55-438b-9997-5198d72f2576 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.149433 Apr 26 14:10:59.241120 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 59/115] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:10:59 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:00.015354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:00.015965 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:00.022315 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:00.022828 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:00.025302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:00.025302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:00.154446 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:00.161940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a668b8f0-921e-40f2-8562-e6dce0b1baca tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.150553 Apr 26 14:11:00.166706 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 57/116] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:00 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:00.241141 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:00.241752 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:00.247569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:00.248017 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:00.248775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:00.249269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:00.257649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:00.258321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:00.263993 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:00.264442 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:00.265247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:00.265681 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:00.390000 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:00.401916 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2378342b-bb03-4a4b-8980-c9206058c7e4 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1315 microversion: 2.1 time: 0.161626 Apr 26 14:11:00.401916 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 60/117] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:00 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:00.421765 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:00.428975 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e2d0fcbd-9e2a-466d-b056-4bb2253a6d0d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.175811 Apr 26 14:11:00.429545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 58/118] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:00 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:01.181435 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:01.182092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:01.188430 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:01.188965 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:01.189758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:01.190232 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:01.338590 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:01.345935 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1ec199d9-bfda-49d7-afad-796c189064ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1363 microversion: 2.1 time: 0.170304 Apr 26 14:11:01.346493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 61/119] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:01 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:01.417150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:01.419017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:01.426314 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:01.427015 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:01.428483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:01.429124 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:01.446173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:01.452105 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:01.459569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:01.459947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:01.461781 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:01.462373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:01.639878 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:01.649575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-47a0f765-c9fc-4b4a-98a0-06be2dbeb7b5 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1502 microversion: 2.1 time: 0.236876 Apr 26 14:11:01.658103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 59/120] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:01 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1502 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:01.682539 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:01.692767 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-daecf9c6-15aa-4036-978e-cbf413490715 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1322 microversion: 2.1 time: 0.250529 Apr 26 14:11:01.693453 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 62/121] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:01 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:02.363939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:02.364568 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:02.371175 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:02.371724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:02.372682 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:02.373121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:02.558836 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:02.572404 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0bbae8dd-047c-4e31-b816-20610d87d270 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1549 microversion: 2.1 time: 0.213535 Apr 26 14:11:02.572980 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 60/122] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:02 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1549 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:02.595641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:02.595641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:02.599994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:02.600610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:02.601557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:02.602182 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:02.713060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:02.713850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:02.721509 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:02.722215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:02.723179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:02.723782 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:02.794759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e74b7f20-c21d-479f-8115-b0f7e58051fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206758 Apr 26 14:11:02.795545 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 63/123] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:11:02 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-interface => generated 284 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:11:03.241943 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:03.250856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6bf3f350-f0dc-48c1-bf4c-760f6a3b6a4e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1516 microversion: 2.1 time: 0.541549 Apr 26 14:11:03.251583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 61/124] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:02 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1516 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:03.274784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:03.274784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:03.292910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:03.292910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:03.293649 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:03.294222 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:03.340531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'flavor' on Instance uuid b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:11:03.675860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ea6910-8222-4b39-b2d9-37b2515ed5df"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:03.676997 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:03.687352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:03.687995 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:03.688927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:03.689369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:03.748116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c3f9e363-671c-42ba-b5e0-8e1e25b3b5d2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7/action" status: 200 len: 32 microversion: 2.1 time: 0.479576 Apr 26 14:11:03.749499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 64/125] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:11:03 2022] POST /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7/action => generated 32 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:11:03.759659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:03.760534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:03.774909 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:03.775369 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:03.779488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:03.780016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:03.987903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:03.995477 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3b6fa95f-2efe-4341-9bf1-079c3be35121 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.240328 Apr 26 14:11:03.996070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 65/126] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:03 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:04.681748 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-91e68c31-b723-47d7-9aa1-6380779faa2c tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "POST /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.008990 Apr 26 14:11:04.682903 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 62/127] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:11:03 2022] POST /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a/os-volume_attachments => generated 194 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:11:05.017698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:05.020836 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:05.033906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:05.035516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:05.036825 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:05.037911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:05.078564 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-dbe5ed94-691f-4d4b-a848-d323544f97a2 req-a2e4feea-4547-4cbf-b642-c2f85539244c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "feac5dcc-29a9-415d-9898-564338c394d0", "tag": "ca1854d6-548d-485b-8cbc-1f2457d13483"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:05.097271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-dbe5ed94-691f-4d4b-a848-d323544f97a2 req-a2e4feea-4547-4cbf-b642-c2f85539244c service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:05.097271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-dbe5ed94-691f-4d4b-a848-d323544f97a2 req-a2e4feea-4547-4cbf-b642-c2f85539244c service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:05.131312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-dbe5ed94-691f-4d4b-a848-d323544f97a2 req-a2e4feea-4547-4cbf-b642-c2f85539244c service nova] Creating event network-changed:ca1854d6-548d-485b-8cbc-1f2457d13483 for instance feac5dcc-29a9-415d-9898-564338c394d0 on hv-cinder-83513 Apr 26 14:11:05.143373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-dbe5ed94-691f-4d4b-a848-d323544f97a2 req-a2e4feea-4547-4cbf-b642-c2f85539244c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071719 Apr 26 14:11:05.144858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 63/128] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:11:05.376770 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:05.390924 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-62486dd6-a603-4b2b-9ded-00151f68e7bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.379986 Apr 26 14:11:05.397779 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 66/129] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:05 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:06.417687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:06.418422 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:06.426459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:06.426919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:06.427710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:06.428153 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:06.621642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:06.632512 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-99e0d5ac-fe07-4568-a1b9-6b28caf7bae9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.220836 Apr 26 14:11:06.641778 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 64/130] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:06 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:07.649578 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:07.657085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:07.663845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:07.664396 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:07.665353 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:07.665786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:07.805608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:07.813044 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2e838bd5-1fbb-4ff1-8eef-4fed07b6097c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.167797 Apr 26 14:11:07.813608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 67/131] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:07 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:08.834282 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:08.834894 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:08.842831 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:08.843287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:08.844073 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:08.844672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:09.006024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:09.013070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-75490630-7cab-4d76-a0c7-b36dfab84606 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.183042 Apr 26 14:11:09.013640 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 65/132] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:08 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:10.030371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:10.031122 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:10.041777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:10.041777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:10.043118 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:10.044906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:10.205389 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:10.213267 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-710e8bfd-d214-4dbf-a1ff-a11acb2c3938 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.186805 Apr 26 14:11:10.213845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 68/133] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:10 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:11.230374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:11.230973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:11.237661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:11.238136 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:11.238893 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:11.239328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:11.378839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:11.386109 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e39165e8-6380-416d-8b4f-89a763733257 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.159491 Apr 26 14:11:11.386671 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 66/134] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:11 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:12.404379 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:12.406012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:12.414095 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:12.415116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:12.416285 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:12.417654 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:12.568852 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:12.576191 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-80aa9ab6-db47-40db-91ef-ef436ab05dac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.176139 Apr 26 14:11:12.576846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 69/135] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:12 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:13.592647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:13.593138 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:13.599909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:13.600381 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:13.604375 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:13.604375 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:13.736682 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:13.744674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e58188b0-3307-4449-afcb-61acb534f22f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.156066 Apr 26 14:11:13.745292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 67/136] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:13 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:14.762042 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:14.762649 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:14.768487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:14.768931 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:14.769684 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:14.770143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:15.120417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:15.128263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3e74437d-fa68-4987-814b-3151e022b688 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.369506 Apr 26 14:11:15.129013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 70/137] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:14 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:16.146306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:16.147120 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:16.153646 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:16.154180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:16.154919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:16.155496 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:16.308434 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:16.315810 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-79193014-5d9f-4e9d-baee-d2bda01148b2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.174850 Apr 26 14:11:16.316393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 68/138] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:16 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:17.332568 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:17.333186 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:17.338919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:17.339362 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:17.340123 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:17.340554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:17.476399 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:17.483782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-db4728ba-b009-44d5-ad9d-6d0dd3719e38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.155046 Apr 26 14:11:17.484336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 71/139] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:17 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:18.500837 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:18.501439 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:18.508398 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:18.508847 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:18.509602 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:18.510075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:19.067531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:19.075268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-081a8250-87ff-49a0-9c89-35cdffc7b296 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.578128 Apr 26 14:11:19.085642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 69/140] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:18 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:20.092783 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:20.093682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:20.102702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:20.103771 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:20.105898 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:20.106371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:20.256516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:20.264217 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-01ec30b1-b9f2-4141-bf89-30a88d52fcf7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.175429 Apr 26 14:11:20.277466 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 72/141] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:20 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:20.475101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:20.475606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:20.483321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:20.483771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:20.486335 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:20.488916 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:20.577465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:11:21.049032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c6e086ff-7673-431f-ab8f-25ab528866b8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "DELETE /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 204 len: 0 microversion: 2.1 time: 0.578018 Apr 26 14:11:21.049655 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 70/142] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:11:20 2022] DELETE /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:11:21.058291 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:21.058835 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:21.065933 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:21.072009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:21.078049 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:21.078049 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:21.248761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:21.269949 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-14927ac9-094f-4e63-b828-113701ab7136 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1554 microversion: 2.1 time: 0.215666 Apr 26 14:11:21.271532 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 73/143] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:21 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:21.286295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:21.287000 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:21.294072 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:21.294708 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:21.295733 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:21.296392 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:21.456393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:21.463968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8df46f71-373b-4706-a649-6e5209bf0cb7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.181854 Apr 26 14:11:21.464476 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 71/144] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:21 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:22.288205 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:22.288822 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:22.294694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:22.296810 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:22.297166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:22.297615 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:22.459803 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:22.471850 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6202d74a-5301-44b4-bfa4-f4db08236dad tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1554 microversion: 2.1 time: 0.187431 Apr 26 14:11:22.472656 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 74/145] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:22 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1554 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:22.481331 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:22.481936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:22.488967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:22.489437 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:22.490420 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:22.490854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:22.708147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:22.718806 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ca039c77-1d13-4f5a-96b8-ae0f4c0c2333 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.239668 Apr 26 14:11:22.722530 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 72/146] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:22 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:23.489394 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:23.490234 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:23.497479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:23.498497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:23.499544 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:23.500190 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:23.753995 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:23.754502 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:23.786478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:23.787068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:23.790085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:23.790693 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:23.836829 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:23.848678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-08a154ee-e172-4547-9aa6-820658b6fae8 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1554 microversion: 2.1 time: 0.363008 Apr 26 14:11:23.858954 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 75/147] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:23 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1554 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:24.129507 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:24.169481 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e1151495-3ff3-4f4e-a6e1-1435d2fdeb80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.437472 Apr 26 14:11:24.181138 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 73/148] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:23 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:24.867861 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:24.870417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:24.887498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:24.890195 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:24.891283 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:24.891966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:24.983614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:25.003346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-dc7584b9-df0b-49c5-8d58-2066762750ee req-829d2f2b-5058-4cf4-8824-f65770174b87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273cc945-5e47-4750-931a-a753cceef77a", "name": "network-vif-deleted", "tag": "deabb5f0-90be-4df9-8257-aa30c4322106"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:25.007444 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-40d4f0c7-9568-4d5d-981d-797edeebda35 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1512 microversion: 2.1 time: 0.146331 Apr 26 14:11:25.014521 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-dc7584b9-df0b-49c5-8d58-2066762750ee req-829d2f2b-5058-4cf4-8824-f65770174b87 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:25.017120 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-dc7584b9-df0b-49c5-8d58-2066762750ee req-829d2f2b-5058-4cf4-8824-f65770174b87 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:25.018490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 76/149] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:24 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:25.051567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-dc7584b9-df0b-49c5-8d58-2066762750ee req-829d2f2b-5058-4cf4-8824-f65770174b87 service nova] Creating event network-vif-deleted:deabb5f0-90be-4df9-8257-aa30c4322106 for instance 273cc945-5e47-4750-931a-a753cceef77a on hv-cinder-83513 Apr 26 14:11:25.056540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-dc7584b9-df0b-49c5-8d58-2066762750ee req-829d2f2b-5058-4cf4-8824-f65770174b87 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057679 Apr 26 14:11:25.057671 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 74/150] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:11:25.198121 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:25.198807 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:25.204789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:25.206521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:25.207639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:25.208072 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:25.395239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:25.401775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-19e62453-39fd-40a0-86f3-7ca572dcd84a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.207189 Apr 26 14:11:25.408177 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 77/151] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:25 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:26.036826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:26.037887 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:26.051543 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:26.051995 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:26.052773 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:26.053200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:26.136886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:26.147235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e9ff8d86-bd36-4f95-92f4-4a37cddf09ab tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1512 microversion: 2.1 time: 0.113719 Apr 26 14:11:26.147235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 75/152] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:26 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1512 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:26.420415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:26.422167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:26.433756 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:26.434346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:26.435378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:26.435901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:26.725353 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:26.734682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bdc25ebe-1937-4405-ac57-c2f341c936fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.317989 Apr 26 14:11:26.745138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 78/153] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:26 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:27.163298 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:27.163871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:27.170944 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:27.171589 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:27.172514 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:27.173087 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:27.294681 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:27.308868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-cdfd02df-22b6-45ea-8345-acb02b8e00b1 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1512 microversion: 2.1 time: 0.149485 Apr 26 14:11:27.319741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 76/154] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:27 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:27.759570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:27.763319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:27.773126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:27.773126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:27.773126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:27.778187 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:28.044473 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:28.052364 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c6b7005f-6ad1-4193-89e1-c376ae4da756 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.303866 Apr 26 14:11:28.052956 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 79/155] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:27 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:28.327281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:28.327879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:28.337274 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:28.340596 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:28.343450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:28.344087 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:28.649097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:28.649097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-64062503-a719-48a0-b815-fa5cf5729537 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1346 microversion: 2.1 time: 0.204333 Apr 26 14:11:28.649097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 77/156] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:28 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1346 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:29.069095 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:29.069673 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:29.075446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:29.075883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:29.076643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:29.077090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:29.242208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:29.263193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-94a34078-08c6-4337-9a1c-e95afd4ae360 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.188545 Apr 26 14:11:29.263193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 80/157] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:29 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:29.645897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:29.658230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:29.658230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:29.658230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:29.658230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:29.659255 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:29.757711 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:29.765737 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9f80aed1-8a12-4b0c-b0b8-c3d403e8edfe tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1346 microversion: 2.1 time: 0.124124 Apr 26 14:11:29.767109 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 78/158] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:29 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:30.275051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:30.276397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:30.284999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:30.285777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:30.286797 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:30.287775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:30.473702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:30.482903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0c4a06e3-3d5d-469c-8f13-aa303dfb780a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.214051 Apr 26 14:11:30.483814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 81/159] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:30 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:30.784774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:30.785515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:30.792886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:30.793335 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:30.794152 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:30.794588 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:30.857958 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:30.866685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4e3af0d9-0ecb-4fac-9cbd-5e142e28d9d6 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1346 microversion: 2.1 time: 0.086631 Apr 26 14:11:30.867472 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 79/160] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:30 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:31.501134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:31.501777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:31.511134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:31.512320 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:31.513284 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:31.514807 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:31.712489 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:31.723571 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8f2816a7-f6c5-4971-b480-3fb64bb4e4b7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.226650 Apr 26 14:11:31.733826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 82/161] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:31 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:31.884238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:31.884838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:31.896454 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:31.900727 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:31.900727 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:31.900727 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:31.951199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:31.951890 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:31.952517 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lazy-loading 'fault' on Instance uuid 273cc945-5e47-4750-931a-a753cceef77a {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:11:32.013272 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c8c139c181344259612105edd7d207d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8a12641de140b68d42fda0758a97ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:32.024297 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a49f7311-488d-4155-9334-be6e7c5337de tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 200 len: 1351 microversion: 2.1 time: 0.143872 Apr 26 14:11:32.025458 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 80/162] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:31 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 1351 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:32.740638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:32.741230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:32.752032 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:32.752772 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:32.753729 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:32.755319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:33.000336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:33.007046 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-25b79334-11a3-4121-8a76-4be7204f30dc tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.270233 Apr 26 14:11:33.007632 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 83/163] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:32 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:33.043028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:33.043730 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:33.050637 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:33.051333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:33.052554 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:33.053140 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:33.068984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] HTTP exception thrown: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. Apr 26 14:11:33.069869 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Returning 404 to user: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:11:33.071001 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f9d9a3c6-d676-4c16-8535-a7e1bd791979 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 404 len: 111 microversion: 2.1 time: 0.032404 Apr 26 14:11:33.071595 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 81/164] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:33 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:11:33.200539 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:33.202166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:33.209173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:33.209895 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:33.211076 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:33.211607 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:33.227202 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] HTTP exception thrown: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. Apr 26 14:11:33.228288 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Returning 404 to user: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:11:33.229333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d7193e09-9e52-49b2-a7fb-e07e21f229fb tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035464 Apr 26 14:11:33.229994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 84/165] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:11:33 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:11:34.024643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:34.025588 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:34.033168 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:34.034157 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:34.035213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:34.035847 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:34.393053 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:34.404170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-90206f93-d97c-4edd-8584-88631d799629 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.381225 Apr 26 14:11:34.405407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 82/166] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:34 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:34.649018 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:34.650383 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:34.662740 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:34.666301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:34.667464 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:34.668844 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:34.696948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] HTTP exception thrown: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. Apr 26 14:11:34.698503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Returning 404 to user: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:11:34.699557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-14f13f5f-ee5a-40e2-94b3-7bf89d1bacb3 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "DELETE /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 404 len: 111 microversion: 2.1 time: 0.055045 Apr 26 14:11:34.706412 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 85/167] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:11:34 2022] DELETE /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:11:34.726544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:34.726544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] [instance: 273cc945-5e47-4750-931a-a753cceef77a] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:34.735373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:34.737180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:34.738209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:34.739657 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:34.768851 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] HTTP exception thrown: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. Apr 26 14:11:34.769648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] Returning 404 to user: Instance 273cc945-5e47-4750-931a-a753cceef77a could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:11:34.770780 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1ad7511c-43c8-41de-944d-86fd70e004c2 tempest-DeleteServersTestJSON-1539555882 tempest-DeleteServersTestJSON-1539555882-project] 10.222.0.23 "GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a" status: 404 len: 111 microversion: 2.1 time: 0.064289 Apr 26 14:11:34.771602 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 83/168] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:34 2022] GET /compute/v2.1/servers/273cc945-5e47-4750-931a-a753cceef77a => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:11:35.422524 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:35.423135 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:35.429646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:35.430349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:35.433082 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:35.433082 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:35.729902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:35.741149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bd0a538d-a31d-46a1-b772-2bb44b805883 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.322305 Apr 26 14:11:35.756527 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 86/169] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:35 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:36.764612 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:36.765200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:36.789367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:36.789367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:36.789367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:36.789367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:37.115632 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:37.129578 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fcac0e3f-1cdf-49fe-a4bb-f79d1e0abfe8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.367013 Apr 26 14:11:37.130897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 84/170] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:36 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:38.158503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:38.161801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:38.178275 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:38.179213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:38.180140 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:38.181733 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:38.418202 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:38.438275 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-db81b57a-eb22-4032-bdf1-a00a927342d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.293606 Apr 26 14:11:38.440156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 87/171] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:38 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:39.462714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:39.462714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:39.483073 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:39.486350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:39.488804 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:39.489564 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:39.717333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:39.725990 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-89ffb992-69a2-44ba-9a80-13575c50f51e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1522 microversion: 2.1 time: 0.273749 Apr 26 14:11:39.726562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 85/172] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:39 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:40.748081 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:40.748686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:40.760569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:40.761523 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:40.762354 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:40.762972 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:40.937758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:40.972070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b6b76054-db6d-47d7-b6b7-7f09fb72cbea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1502 microversion: 2.1 time: 0.227690 Apr 26 14:11:40.977535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 88/173] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:40 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:40.990581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:40.991204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:41.004959 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:41.011518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:41.011518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:41.011518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:41.248791 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:41.270708 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ba8343fa-7c7c-428c-820a-04f803e3195e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1514 microversion: 2.1 time: 0.272445 Apr 26 14:11:41.271298 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 86/174] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:40 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:43.494775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:43.498299 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:43.513612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:43.514087 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:43.523104 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:43.523666 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:43.571595 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'flavor' on Instance uuid 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:11:43.925311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ecde7650-845b-4c3d-ae4e-92f3baf9b3f9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8/action" status: 200 len: 32 microversion: 2.1 time: 0.436812 Apr 26 14:11:43.935694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:43.936936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:43.939869 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 89/175] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:11:43 2022] POST /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8/action => generated 32 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:11:43.951559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:43.953575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:43.959117 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:43.959857 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:44.832829 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:44.841322 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-310d4272-745a-4983-ab11-8e2099feefec tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.909843 Apr 26 14:11:44.841909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 87/176] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:43 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:45.859247 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:45.859943 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:45.866748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:45.867202 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:45.867969 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:45.868410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:46.319706 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:46.331504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5a252baa-de92-4193-bd11-a07ca3834ae7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.473492 Apr 26 14:11:46.332128 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 90/177] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:45 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:47.350647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:47.351504 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:47.359328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:47.360004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:47.361698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:47.362309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:47.488568 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-19b7dd1b-5934-407f-9320-20b14681d5a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Action: 'create', calling method: .version_select at 0x7f40676fbee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-786929227"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:47.525062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-19b7dd1b-5934-407f-9320-20b14681d5a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Getting quotas for project 9211b70dd81f45fa8abd2cfaf151e4d6. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:47.536571 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-19b7dd1b-5934-407f-9320-20b14681d5a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Getting quotas for user 052eaf73262c40e38e14b440fd093738 and project 9211b70dd81f45fa8abd2cfaf151e4d6. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:47.697116 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:47.707979 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-99bea192-7f4e-455c-a74f-ab9ed4ddc69f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.363090 Apr 26 14:11:47.708581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 88/178] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:47 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:47.839202 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-19b7dd1b-5934-407f-9320-20b14681d5a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Getting quotas for project 9211b70dd81f45fa8abd2cfaf151e4d6. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:47.844617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-19b7dd1b-5934-407f-9320-20b14681d5a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Getting quotas for user 052eaf73262c40e38e14b440fd093738 and project 9211b70dd81f45fa8abd2cfaf151e4d6. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:47.859581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-19b7dd1b-5934-407f-9320-20b14681d5a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.375432 Apr 26 14:11:47.861610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 91/179] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:11:47 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:48.002559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2147386461", "imageRef": "fbcfbab6-f42a-4cfe-9305-75b45299945a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-786929227", "networks": [{"uuid": "39bb26a1-84de-43e7-8b61-6213bc37b526"}]}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:48.070744 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] validate_networks() for [('39bb26a1-84de-43e7-8b61-6213bc37b526', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:11:48.656638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:11:48.657182 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:11:48.659166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:11:48.659893 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:11:48.660459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:11:48.682028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:48.682493 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:48.683373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:48.683831 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:48.723857 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Getting quotas for project 9211b70dd81f45fa8abd2cfaf151e4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:48.725708 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:48.726501 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:48.733453 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Getting quotas for user 052eaf73262c40e38e14b440fd093738 and project 9211b70dd81f45fa8abd2cfaf151e4d6. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:48.737523 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:48.738001 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:48.744386 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:48.748124 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:48.755689 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:11:48.757944 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fbcfbab6-f42a-4cfe-9305-75b45299945a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:11:48.968253 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-36297834-44b4-4071-85fb-eb3ef836b977 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970095 Apr 26 14:11:48.969508 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 89/180] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:11:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:11:48.979312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5d91460a-3470-4b9c-aab9-b55787de4f58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:48.980165 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5d91460a-3470-4b9c-aab9-b55787de4f58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:49.060777 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5d91460a-3470-4b9c-aab9-b55787de4f58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:49.066936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5d91460a-3470-4b9c-aab9-b55787de4f58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1258 microversion: 2.1 time: 0.090175 Apr 26 14:11:49.068104 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 90/181] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:48 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:49.105234 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:49.120716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-89bbb775-7fd7-49f4-a06d-5fc850fcdf2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.397124 Apr 26 14:11:49.121415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 92/182] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:48 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:49.532883 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6c498751-bad8-4e6e-bb73-fc100eee9e7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: .version_select at 0x7f406d3bac10>, body: {"keypair": {"name": "tempest-keypair-389141440"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:49.551762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6c498751-bad8-4e6e-bb73-fc100eee9e7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:49.555982 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6c498751-bad8-4e6e-bb73-fc100eee9e7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:49.882650 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-900171319", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "networks": [{"uuid": "1a702bb0-0366-46dc-8d15-e85f42f915e6"}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:49.938576 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] validate_networks() for [('1a702bb0-0366-46dc-8d15-e85f42f915e6', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:11:50.103815 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6c498751-bad8-4e6e-bb73-fc100eee9e7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:50.110235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6c498751-bad8-4e6e-bb73-fc100eee9e7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:50.125089 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6c498751-bad8-4e6e-bb73-fc100eee9e7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.714044 Apr 26 14:11:50.125687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 91/183] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:11:49 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:50.130528 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c8e1cf98-e61e-438e-8409-f65ecc940e66 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:50.131402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c8e1cf98-e61e-438e-8409-f65ecc940e66 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:50.189173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c8e1cf98-e61e-438e-8409-f65ecc940e66 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:50.198068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c8e1cf98-e61e-438e-8409-f65ecc940e66 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1258 microversion: 2.1 time: 0.069784 Apr 26 14:11:50.208104 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 92/184] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:50 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1258 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:50.213839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:50.214659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:50.222228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:50.222930 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:50.223764 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:50.225257 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:50.395738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:11:50.396560 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:11:50.397208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:11:50.398487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:11:50.399092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:11:50.409590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:50.420723 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ba26c617-b03f-43d1-a110-e115a1115987 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.211346 Apr 26 14:11:50.424413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 93/185] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:50 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:50.425030 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:50.425644 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:50.426657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:50.427131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:50.451475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Getting quotas for project e9ba0d67b78f4c59b3d8e1ea5ae2895d. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:50.457401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Getting quotas for user 0b6057ad951e418a9d60de92517ae089 and project e9ba0d67b78f4c59b3d8e1ea5ae2895d. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:50.469687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:11:50.472504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:11:50.638523 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2346e2f7-9c78-4afe-a9a7-8dc0ce9f71b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761748 Apr 26 14:11:50.639636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 93/186] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:11:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 26 14:11:50.651967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b063c41d-cd6f-4f40-b952-4edc7748d291 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:50.652893 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b063c41d-cd6f-4f40-b952-4edc7748d291 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:50.756537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b063c41d-cd6f-4f40-b952-4edc7748d291 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:50.768835 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b063c41d-cd6f-4f40-b952-4edc7748d291 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1213 microversion: 2.1 time: 0.118681 Apr 26 14:11:50.794408 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 94/187] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:50 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:51.215312 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:51.215805 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:51.232562 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:51.232562 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:51.232562 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:51.232562 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:51.320991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:51.328167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5c047616-0a3b-486a-b80b-d1168c1d8f51 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1254 microversion: 2.1 time: 0.116979 Apr 26 14:11:51.328760 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 94/188] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:51 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1254 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:51.453163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:51.453785 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:51.463252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:51.464112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:51.465084 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:51.465697 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:51.676116 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:51.684594 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-67857025-2612-4615-bb11-a0b2b7f5b5ac tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.237558 Apr 26 14:11:51.685387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 95/189] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:51 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:51.788755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-cf394c06-4f24-49ca-8dda-651dd195a831 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:51.789614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cf394c06-4f24-49ca-8dda-651dd195a831 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:51.902070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-cf394c06-4f24-49ca-8dda-651dd195a831 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:51.910752 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-cf394c06-4f24-49ca-8dda-651dd195a831 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1213 microversion: 2.1 time: 0.125714 Apr 26 14:11:51.925984 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 95/190] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:51 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1213 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:52.107927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:52.109987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:52.131242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.131877 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.132886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.133530 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.193780 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-aced29ae-9e74-4847-a0e7-478ae5acf243 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/ips" status: 200 len: 146 microversion: 2.1 time: 0.089262 Apr 26 14:11:52.211950 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 96/191] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:11:52 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/ips => generated 146 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:11:52.354702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:52.355921 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:52.364402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.364851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.366913 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.367359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.459462 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:52.482355 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2a2f3bb8-a94b-472e-946b-69f819355535 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1318 microversion: 2.1 time: 0.130182 Apr 26 14:11:52.497388 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 96/192] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:52 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:52.702381 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:52.703231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:52.710545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.711302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.712286 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.713002 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.932167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:52.932896 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:52.955769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.956247 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:52.957068 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:52.957513 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:53.044561 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:53.065566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d7b0ce5b-4b97-4df6-91af-5c4f0ce93057 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1209 microversion: 2.1 time: 0.137737 Apr 26 14:11:53.083100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 97/193] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:52 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1209 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:53.217937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:53.228569 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9a92e9ff-a238-48d4-a57c-3a0bc84ceca7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.530803 Apr 26 14:11:53.243329 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 97/194] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:52 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:53.502734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:53.503966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:53.509864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:53.510782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:53.511749 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:53.512205 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:53.578917 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:53.586985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6de32f99-41cc-4162-9146-831cd0f42311 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1316 microversion: 2.1 time: 0.088093 Apr 26 14:11:53.587614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 98/195] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:53 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1316 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:54.092885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:54.094079 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:54.100485 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:54.100937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:54.101709 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:54.102177 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:54.203059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:54.211727 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fa0e46be-429c-4f52-a12e-2494374d41eb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1273 microversion: 2.1 time: 0.124368 Apr 26 14:11:54.247138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:54.247776 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:54.250863 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 98/196] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:54 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1273 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:54.259432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:54.260343 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:54.263122 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:54.263780 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:54.609864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:54.611207 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:54.639234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:54.639967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:54.640974 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:54.646491 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:54.792907 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:54.806296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-28cc6c29-c510-4217-825d-1435d481ee3b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.562414 Apr 26 14:11:54.808605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 99/197] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:54 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:55.106653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-910099374", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db62da73-59c6-4f6f-98fa-3d9fee96e03d"}], "security_groups": [{"name": "tempest-securitygroup--1624461636"}], "key_name": "tempest-keypair-389141440", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:55.353794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] validate_networks() for [('db62da73-59c6-4f6f-98fa-3d9fee96e03d', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:11:55.370052 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:55.397822 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-713fe781-5ce9-4023-88cb-bd24df06dad1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.795501 Apr 26 14:11:55.399861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 99/198] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:54 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:55.417250 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:55.417250 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:55.453667 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:55.457005 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:55.460939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:55.464548 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:55.579597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:55.590192 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e5896753-0bda-49f1-a89f-d6856fd4fd37 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1271 microversion: 2.1 time: 0.188324 Apr 26 14:11:55.592338 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 100/199] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:55 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1271 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:55.826835 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:55.827740 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:55.835240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:55.836225 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:55.837394 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:55.838545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:56.300860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:56.310658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-af02f06a-9cca-40a6-821f-086b4ea14a84 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.488281 Apr 26 14:11:56.321903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:11:56.323052 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:11:56.323732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:11:56.324310 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:11:56.324830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 101/200] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:55 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:56.324967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:11:56.357724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:56.359288 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:56.363347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:56.369026 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:56.416075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:56.417415 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:56.419919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:11:56.431149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:11:56.442190 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:56.447332 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:56.448197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:56.448652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:56.464533 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:11:56.473173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:11:56.678162 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ebc263ae-8384-4f30-9b4c-a5f71bda4d3f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.574989 Apr 26 14:11:56.682511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 100/201] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:11:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 1582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 26 14:11:56.691012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:56.702968 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:56.721802 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:56.723285 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:56.728452 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:56.733471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:57.060590 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:57.079539 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b75cc811-61f7-4443-b51c-db7acb32a1b0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.385926 Apr 26 14:11:57.079539 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 101/202] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:56 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:57.084113 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-045c4531-dd20-411c-9148-749738578c6d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:57.084820 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-045c4531-dd20-411c-9148-749738578c6d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:57.183389 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-045c4531-dd20-411c-9148-749738578c6d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:57.218582 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-045c4531-dd20-411c-9148-749738578c6d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1240 microversion: 2.1 time: 0.144122 Apr 26 14:11:57.230457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 102/203] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:57 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1240 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:57.333880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:57.342441 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:57.353816 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:57.356008 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:57.357018 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:57.357476 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:57.554016 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:57.565891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8b4ad195-7afd-43ab-8b92-df07a1d66278 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 1.154186 Apr 26 14:11:57.582117 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 102/204] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:56 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:57.591320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93f2bbec-5c6d-4e9c-aa1b-3e0db3d669d0"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:57.591320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:57.596885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:57.597631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:57.598720 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:57.599431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:57.776261 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:57.786057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-76835fb7-6c59-45df-9fcc-984f0399f19c tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.457250 Apr 26 14:11:57.787345 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 103/205] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:57 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:58.044074 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-3c0ebafc-3e60-4dc5-827b-24aa4daa21e8 req-9a1c18b3-7ae9-44fd-a157-0e85b958b592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:11:58.059663 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3c0ebafc-3e60-4dc5-827b-24aa4daa21e8 req-9a1c18b3-7ae9-44fd-a157-0e85b958b592 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.064074 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3c0ebafc-3e60-4dc5-827b-24aa4daa21e8 req-9a1c18b3-7ae9-44fd-a157-0e85b958b592 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.114711 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-3c0ebafc-3e60-4dc5-827b-24aa4daa21e8 req-9a1c18b3-7ae9-44fd-a157-0e85b958b592 service nova] Creating event network-changed:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:11:58.126079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-3c0ebafc-3e60-4dc5-827b-24aa4daa21e8 req-9a1c18b3-7ae9-44fd-a157-0e85b958b592 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088508 Apr 26 14:11:58.131657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 104/206] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:11:58.145882 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:58.163244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:58.189456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.190218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.191212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.191846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.433056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:58.448694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7ed143c3-b676-4014-90d6-a00c5e081f39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.314923 Apr 26 14:11:58.453421 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 105/207] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:58 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:58.481267 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:58.489885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:58.511555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.514957 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.517670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.521235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.617408 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-81f250f7-fa11-4d7b-9ec3-365f9259e7be tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.032321 Apr 26 14:11:58.624354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 103/208] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:11:57 2022] POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-volume_attachments => generated 194 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:11:58.638554 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:58.640059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:58.667376 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.669310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.670755 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.673080 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.692761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:58.706344 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-af153648-8b84-4a48-bce1-dff9914ea318 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1244 microversion: 2.1 time: 0.255700 Apr 26 14:11:58.707188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 106/209] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:58 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1244 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:58.803648 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:58.804480 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:58.827316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.827975 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:58.831529 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:58.834126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:59.163728 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:59.173190 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e0297913-6f87-4200-943b-569f895d3ca9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.373276 Apr 26 14:11:59.178947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 107/210] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:58 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:11:59.413470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:59.424450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e3d7b181-b427-451a-becb-e533b1ba2f70 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.795290 Apr 26 14:11:59.426526 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 104/211] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:58 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:59.473114 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:59.475503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:59.484480 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:59.486911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:59.488201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:59.489854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:59.725649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:11:59.726432 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:11:59.735759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:59.736222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:59.741798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:11:59.742871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:11:59.864046 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:59.876306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-862eb089-ff48-469d-9726-33ca479ce47e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.410654 Apr 26 14:11:59.890088 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 108/212] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:59 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:11:59.936727 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:11:59.962288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0bd54e34-1637-4a0b-9316-7f4d20e6ac68 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1292 microversion: 2.1 time: 0.235622 Apr 26 14:11:59.964000 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 105/213] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:11:59 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1292 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:00.214948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:00.214948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:00.214948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.214948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.215620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.215620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.427554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:00.436004 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9e200289-b03e-4249-a82d-70f7b6887330 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.243915 Apr 26 14:12:00.445663 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 109/214] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:00 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:00.449269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:00.449902 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:00.456596 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.457057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.457838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.458310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.697041 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:00.705954 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-82a62402-41a1-41df-ac22-831a735b02a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.266384 Apr 26 14:12:00.706574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 106/215] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:00 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:00.818243 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-3abdf71a-5e67-46e9-b894-91b08834ed2c req-4050532e-ad62-49a8-ab9c-48788604c1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b2e858d-4901-494e-aed1-08b7a3ccda6b", "tag": "a222344d-e5e3-4176-8559-d0bda5c36cdd"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:00.841245 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3abdf71a-5e67-46e9-b894-91b08834ed2c req-4050532e-ad62-49a8-ab9c-48788604c1f3 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.841734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3abdf71a-5e67-46e9-b894-91b08834ed2c req-4050532e-ad62-49a8-ab9c-48788604c1f3 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.861673 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-3abdf71a-5e67-46e9-b894-91b08834ed2c req-4050532e-ad62-49a8-ab9c-48788604c1f3 service nova] Creating event network-changed:a222344d-e5e3-4176-8559-d0bda5c36cdd for instance 8b2e858d-4901-494e-aed1-08b7a3ccda6b on hv-cinder-83513 Apr 26 14:12:00.868519 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-3abdf71a-5e67-46e9-b894-91b08834ed2c req-4050532e-ad62-49a8-ab9c-48788604c1f3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056607 Apr 26 14:12:00.869289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 110/216] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:00.897224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:00.897839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:00.904947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.905635 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.906665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.907694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.981156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:00.981862 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:00.989358 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.989825 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:00.990744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:00.991355 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:01.105993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:01.118193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-601848c1-9644-4f57-822f-8e44e44f6b9d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1292 microversion: 2.1 time: 0.137838 Apr 26 14:12:01.119294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 111/217] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:00 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1292 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:01.177173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:01.188222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-41b84e82-24ab-440d-a4e0-ba646d42c292 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.294529 Apr 26 14:12:01.196225 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 107/218] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:00 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:01.457091 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:01.458192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:01.470792 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:01.471677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:01.473877 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:01.475195 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:01.710341 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:01.723758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-caa1f432-bf99-49fd-9a91-b42f9e19290f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.272048 Apr 26 14:12:01.724490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 112/219] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:01 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:01.725331 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:01.725948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:01.744415 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:01.745147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:01.745940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:01.746397 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.065548 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:02.073842 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-201f796f-775f-4d50-9756-0d34dd65cb27 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.354811 Apr 26 14:12:02.080141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 108/220] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:01 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:02.141073 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:02.142714 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:02.152720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:02.153257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.154163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:02.154667 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.212667 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:02.213646 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:02.223096 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:02.223787 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.225575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:02.225575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.271978 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:02.281385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6de87640-c826-4cfc-a41f-0a3c05c827b1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1292 microversion: 2.1 time: 0.145888 Apr 26 14:12:02.289612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 113/221] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:02 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1292 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:02.465076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:02.472486 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d2fcbca8-9585-4362-bf8d-c86a6afb0b7d tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.265220 Apr 26 14:12:02.473052 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 109/222] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:02 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:02.754491 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:02.755480 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:02.791255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:02.791255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.791255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:02.791255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:02.957350 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:02.965540 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f1abf306-1ed0-45b9-9535-c5fe7f37697f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.227122 Apr 26 14:12:02.966731 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 114/223] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:02 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:03.096773 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:03.097484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:03.104985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:03.105562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:03.106558 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:03.106996 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:03.295385 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:03.301063 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:03.302381 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:03.308492 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:03.309566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:03.310450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-38103e09-6371-4429-9961-310f2098ba8f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.214483 Apr 26 14:12:03.310724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:03.311306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:03.314948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 110/224] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:03 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:03.375192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:03.386664 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c8860a30-c054-4910-a93a-c7c159d61277 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1292 microversion: 2.1 time: 0.090298 Apr 26 14:12:03.387892 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 115/225] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:03 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1292 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:03.489300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:03.490495 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:03.501091 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:03.501943 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:03.502969 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:03.503572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:03.682081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:03.704966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-73b3d9be-92b5-42c1-b991-cc4f7dae5621 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.210229 Apr 26 14:12:03.704966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 111/226] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:03 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:03.982750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:03.983360 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:03.995042 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.003740 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.004552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.005203 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.224216 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:04.232222 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5a30f67a-1e25-45b2-a579-b4c0a8f555fb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.253220 Apr 26 14:12:04.238309 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 116/227] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:03 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:04.329632 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:04.331506 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:04.349352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.354057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.358509 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.359033 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.405814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:04.405814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:04.414579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.415218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.416140 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.417029 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.519342 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:04.527401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a4664d56-d1fc-405a-b3b8-da0654bbe11a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1292 microversion: 2.1 time: 0.126505 Apr 26 14:12:04.530806 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 117/228] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:04 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1292 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:04.584274 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:04.593689 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-094f1940-7b88-454b-a819-b6d9534901c8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.268630 Apr 26 14:12:04.597464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 112/229] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:04 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:04.729955 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:04.729955 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:04.730417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.730944 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.732059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:04.732744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:04.898291 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:04.905693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-11850f82-c350-4929-8d35-8cc29b796fcb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.190581 Apr 26 14:12:04.912292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 118/230] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:04 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:05.255057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:05.255741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:05.261842 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.262329 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.263139 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.263584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.546272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:05.546893 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:05.553335 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.554963 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.556201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.557218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.625949 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:05.633915 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1905e9d5-745e-46e1-b8bc-c80f86a5a5a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1300 microversion: 2.1 time: 0.091886 Apr 26 14:12:05.634516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 119/231] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:05 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:05.639231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:05.645285 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:05.646905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.647206 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.647978 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.648409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.820525 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:05.827864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-02f5bee3-e239-4040-a1f0-e239830636b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.192331 Apr 26 14:12:05.828434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 120/232] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:05 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:05.899560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:05.929066 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4bb56439-f643-4cfa-9c24-b1d3cd00b706 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.664640 Apr 26 14:12:05.929066 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 113/233] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:05 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:05.929587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:05.929587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:05.938280 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.938773 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:05.939527 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:05.939974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:06.108217 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:06.117290 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-940c612b-73cc-4661-abd4-66e819e2b5dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.196542 Apr 26 14:12:06.127395 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 121/234] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:05 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:06.652747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:06.653331 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:06.659817 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:06.660370 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:06.661163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:06.661579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:06.728981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:06.737384 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e22b1bcc-c39f-4ecf-90c8-175fc583d1cb tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1298 microversion: 2.1 time: 0.088404 Apr 26 14:12:06.738592 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 114/235] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:06 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:06.846145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:06.846918 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:06.853252 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:06.854038 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:06.855045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:06.855706 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:06.936153 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:06.936861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:06.945120 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:06.945651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:06.946534 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:06.947170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.087192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:07.095641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0d88e86d-4e32-4426-9955-3994e0575a71 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.254342 Apr 26 14:12:07.103626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 122/236] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:06 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:07.134402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:07.135022 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:07.140791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.141310 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.142411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.142850 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.167662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:07.177732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-038dee51-2fa0-4fcb-bf15-506b1ed330a6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1500 microversion: 2.1 time: 0.245822 Apr 26 14:12:07.183301 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 115/237] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:06 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1500 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:07.195466 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e72d659-e193-4d5f-aa53-174488b8a176"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:07.196838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:07.204075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.204534 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.205324 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.205758 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.229600 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] HTTP exception thrown: Cannot 'attach_volume' instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 while it is in vm_state rescued Apr 26 14:12:07.230249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Returning 409 to user: Cannot 'attach_volume' instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 while it is in vm_state rescued {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:12:07.231114 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b0793086-73d1-46a1-a775-45b2acc21a4a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039779 Apr 26 14:12:07.235312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 116/238] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:12:07 2022] POST /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 26 14:12:07.240321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:07.240865 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:07.246720 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.247510 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.248389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.248711 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.315327 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:07.321936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-db13f401-314a-4da8-a35a-03be8c6d8673 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.191037 Apr 26 14:12:07.322636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 123/239] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:07 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:07.516759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e614f2ef-0fa6-481b-815c-deeb07102b97 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8/action" status: 202 len: 0 microversion: 2.1 time: 0.278596 Apr 26 14:12:07.516759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 117/240] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:12:07 2022] POST /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:12:07.524475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:07.525088 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:07.531039 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.531490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.532909 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.533352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.665884 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:07.673770 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-dbcb185e-d19c-4a78-8ac4-fa1b7207310e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.153064 Apr 26 14:12:07.674367 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 124/241] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:07 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:07.755509 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:07.756237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:07.762367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.762824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.763596 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:07.764050 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:07.904215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:07.912621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f3d01df4-01a4-4876-b298-54ca86fd7bf5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.161456 Apr 26 14:12:07.913202 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 118/242] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:07 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:08.112498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:08.113103 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:08.118935 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.119378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.120132 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.120561 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.247707 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:08.255380 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f6f3c473-d693-49e8-bad8-747464f04153 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.146674 Apr 26 14:12:08.255940 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 125/243] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:08 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:08.338232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:08.338845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:08.344724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.345173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.345936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.346414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.473538 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:08.480712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b692c26a-11fc-4358-ac9f-521ec68068dd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.146320 Apr 26 14:12:08.481276 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 119/244] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:08 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:08.691528 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:08.692137 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:08.698083 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.698533 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.699300 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.699737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.831503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:08.838755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-947cbbf6-45c1-4a04-98d5-d50594823bbe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.151556 Apr 26 14:12:08.839323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 126/245] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:08 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:08.928425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:08.929030 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:08.935341 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.935795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:08.936551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:08.936983 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.069060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:09.076672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5afda37a-1bfa-41b9-8877-24ab3d90cce4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.152020 Apr 26 14:12:09.077392 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 120/246] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:08 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:09.272021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:09.272642 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:09.279824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.279824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.280059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.280492 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.415626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:09.423611 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-76660902-b425-41db-a024-21fee1f0dc4a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.155360 Apr 26 14:12:09.424192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 127/247] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:09 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:09.497336 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:09.498135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:09.504060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.504459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.505222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.505654 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.645786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3f8b8cd7-e985-4ee8-bd69-f007d3a6a389 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:09.651743 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3f8b8cd7-e985-4ee8-bd69-f007d3a6a389 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.652192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3f8b8cd7-e985-4ee8-bd69-f007d3a6a389 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.712441 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3f8b8cd7-e985-4ee8-bd69-f007d3a6a389 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Going to try to stop instance {{(pid=117601) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 26 14:12:09.892589 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3f8b8cd7-e985-4ee8-bd69-f007d3a6a389 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action" status: 202 len: 0 microversion: 2.1 time: 0.251068 Apr 26 14:12:09.893183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 128/248] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:12:09 2022] POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:12:09.898544 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:09.899241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:09.907274 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.907732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.908569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.909008 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.955330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:09.966372 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bd966df2-a9ae-416d-9ff0-a3827ca5035a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.472728 Apr 26 14:12:09.970880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 121/249] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:09 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:09.977465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:09.978260 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:09.984715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.985295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:09.986223 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:09.986816 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.134803 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:10.146143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8aa15df3-2005-4b7f-842b-d66e8317787b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.251646 Apr 26 14:12:10.147214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 129/250] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:09 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:10.153264 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:10.154115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:10.160759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.166316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.167285 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.168359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.374845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:10.384215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bad65bc0-67fb-461a-b068-f014016bee9a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.234965 Apr 26 14:12:10.384977 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:10.397210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 130/251] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:10 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:10.397642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c05cf5e6-246a-4f73-b9f5-3d459fe1c316 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.426213 Apr 26 14:12:10.398297 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 122/252] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:09 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:10.441109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:10.441722 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:10.451404 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.451850 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.452634 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.453071 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.622071 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:10.633450 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4d383cd2-8b52-4e7b-a382-f8760d1dedfa tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.193650 Apr 26 14:12:10.633450 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 131/253] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:10 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:10.738741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-625f4ec4-25c5-4c29-be6c-ff1bcac49d3c req-4de00344-6942-49df-88b8-1c6e76c65de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df98b23b-b855-4fcd-ab58-771e1f55e22b", "tag": "ede1cf67-87e7-4b05-824d-155ba5205045"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:10.747185 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-625f4ec4-25c5-4c29-be6c-ff1bcac49d3c req-4de00344-6942-49df-88b8-1c6e76c65de6 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.747677 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-625f4ec4-25c5-4c29-be6c-ff1bcac49d3c req-4de00344-6942-49df-88b8-1c6e76c65de6 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.764661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-625f4ec4-25c5-4c29-be6c-ff1bcac49d3c req-4de00344-6942-49df-88b8-1c6e76c65de6 service nova] Creating event network-changed:ede1cf67-87e7-4b05-824d-155ba5205045 for instance df98b23b-b855-4fcd-ab58-771e1f55e22b on hv-cinder-83513 Apr 26 14:12:10.770550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-625f4ec4-25c5-4c29-be6c-ff1bcac49d3c req-4de00344-6942-49df-88b8-1c6e76c65de6 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039014 Apr 26 14:12:10.772690 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 123/254] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:10.986959 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:10.987690 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:10.993718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.994253 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:10.995205 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:10.995648 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.129991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:11.137204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fefa3e56-96bd-4767-a452-c23f52791e15 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.155045 Apr 26 14:12:11.139801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 132/255] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:10 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:11.164947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:11.165685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:11.171629 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.172731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.172839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.173263 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.302497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:11.310047 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-720da0e0-f3cd-42c2-8505-c83c1f5720ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.149939 Apr 26 14:12:11.310614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 124/256] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:11 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:11.402348 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:11.402959 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:11.408838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.409131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.409910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.410368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.415561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:11.416208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:11.422726 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.423204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.423985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.424426 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.548853 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:11.556538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-17f8dcab-35a9-4e67-8bda-23cbc8887264 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.158008 Apr 26 14:12:11.557315 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 133/257] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:11 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:11.576598 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:11.585085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4e6e350b-f370-4fbd-83b2-cc9dbb1bd813 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.173735 Apr 26 14:12:11.585690 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 125/258] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:11 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:11.647668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:11.648254 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:11.654099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.654570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.655326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:11.655756 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:11.785115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:11.792585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6dd1df73-c76c-4f14-9885-ab807dfed210 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.148822 Apr 26 14:12:11.793182 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 134/259] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:11 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:12.154285 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:12.154902 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:12.161231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.161630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.162672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.163121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.294732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:12.301877 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d61a2867-c3ba-47de-85e7-1fe3191a9f90 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.151428 Apr 26 14:12:12.302488 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 126/260] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:12 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:12.328079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:12.328682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:12.335031 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.335482 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.336249 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.336689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.469410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:12.477920 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f624d2dd-92f9-403c-857b-79ca5fa8e9cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.153424 Apr 26 14:12:12.478474 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 135/261] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:12 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:12.574529 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:12.575172 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:12.581046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.581498 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.582337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.582798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.602102 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:12.602735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:12.608414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.608860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.609619 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.610073 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.726532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:12.734023 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4a974555-4825-41c0-9a3c-49a23ca4aedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.163229 Apr 26 14:12:12.734729 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 127/262] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:12 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:12.753803 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:12.761929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0da155f8-b242-48ca-ba95-bdd1a0e0535f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.163599 Apr 26 14:12:12.762625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 136/263] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:12 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:12.809473 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:12.810126 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:12.817125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.818717 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.818717 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:12.818988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:12.950688 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:12.957925 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-af813177-a047-4ee1-995d-3fe69acd6355 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.152408 Apr 26 14:12:12.958516 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 128/264] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:12 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:13.318064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:13.318587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:13.324361 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.324804 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.325554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.326092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.461471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:13.468758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3ff27d06-e4b9-4660-94da-8b413c996d52 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.154671 Apr 26 14:12:13.469354 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 137/265] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:13 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:13.494844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:13.495695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:13.503416 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.503859 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.505826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.505826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.751914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:13.752520 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:13.758869 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.759314 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.760089 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.760532 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.901339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:13.909321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5a5d0e5c-067c-4cfe-8277-7ff89226d239 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.161791 Apr 26 14:12:13.909900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 138/266] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:13 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:13.927660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:13.928676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:13.929693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:13.935416 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ebd9b77a-4a1b-419d-ba85-84f238b0f049 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.444415 Apr 26 14:12:13.935986 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 129/267] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:13 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:13.942230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.942758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.948570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.948570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.974964 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:13.975597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:13.994208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.995102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:13.996065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:13.996652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:14.109463 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:14.117576 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-273a53bc-71ab-48d7-a132-4682464900c5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.206517 Apr 26 14:12:14.118298 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 139/268] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:13 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:14.339414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:14.347451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e996307c-6e31-4b7b-958c-1ddafa0240bd tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.376436 Apr 26 14:12:14.348022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 130/269] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:13 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:14.489617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:14.490394 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:14.500204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:14.501552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:14.502926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:14.503718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:14.666759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:14.680262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-018a05ec-8a25-4e13-861f-3b2ca87758bb tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.195444 Apr 26 14:12:14.682308 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 140/270] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:14 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:14.928240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:14.928849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:14.935398 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:14.935843 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:14.936614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:14.937046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:14.952771 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:14.954211 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:14.960229 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:14.960908 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:14.962411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:14.970434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.103401 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:15.106215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8131d812-5bde-4357-99c4-9c9792657e55 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.182031 Apr 26 14:12:15.107496 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 131/271] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:14 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:15.136118 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:15.140167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:15.144108 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.144780 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.145567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.146024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.152761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:15.161063 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0ee20aaf-c5c8-47f4-91d3-b0ec73f33b21 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1508 microversion: 2.1 time: 0.212140 Apr 26 14:12:15.161856 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 141/272] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:14 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:15.307319 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:15.315279 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-05a9f063-c5ed-4f53-a1e0-9a41360fdb1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.184022 Apr 26 14:12:15.316170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 132/273] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:15 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:15.364681 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:15.365398 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:15.382329 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.382329 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.382329 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.382329 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.528928 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:15.537138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-97067257-f9b3-4836-a06b-ae46d81761ac tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.176974 Apr 26 14:12:15.538015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 142/274] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:15 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:15.698444 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:15.698975 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:15.705280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.705891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.706698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.707133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.843290 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:15.851561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-efeb19f4-b1b6-4f5c-979e-7255e01d1cfc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.157273 Apr 26 14:12:15.852141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 133/275] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:15 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:15.930172 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-888d3546-e78e-42c9-abf0-737ef5a2f7cb req-b0ea55f6-1d6d-406e-b92b-9c252b465b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "name": "network-vif-plugged", "status": "completed", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:15.940284 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-888d3546-e78e-42c9-abf0-737ef5a2f7cb req-b0ea55f6-1d6d-406e-b92b-9c252b465b70 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:15.941606 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-888d3546-e78e-42c9-abf0-737ef5a2f7cb req-b0ea55f6-1d6d-406e-b92b-9c252b465b70 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:15.956768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-888d3546-e78e-42c9-abf0-737ef5a2f7cb req-b0ea55f6-1d6d-406e-b92b-9c252b465b70 service nova] Creating event network-vif-plugged:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:12:15.962100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-888d3546-e78e-42c9-abf0-737ef5a2f7cb req-b0ea55f6-1d6d-406e-b92b-9c252b465b70 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035889 Apr 26 14:12:15.962906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 143/276] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:16.124625 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:16.125232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:16.132121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.132565 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.133320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.133751 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.179678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:16.180374 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:16.186492 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.186942 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.187711 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.188149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.274228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:16.282024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b6a9561f-1f52-4719-b67d-d443b0f88630 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.161184 Apr 26 14:12:16.282794 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 134/277] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:16 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:16.332416 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:16.333340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:16.343786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.343786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.343786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.343786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.352208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:16.361574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ceedb7b2-1600-419f-a68a-7673f1fdfe6d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1514 microversion: 2.1 time: 0.186034 Apr 26 14:12:16.362561 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 144/278] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:16 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:16.529615 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:16.537414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3502e126-b67d-478a-8b79-ed5abfe7f281 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.208822 Apr 26 14:12:16.538247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 135/279] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:16 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:16.555152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:16.555763 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:16.562214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.562798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.564257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.564944 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.702852 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:16.710075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e0f27553-a3ca-4696-bc04-b17a55948e44 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.159073 Apr 26 14:12:16.710638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 145/280] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:16 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:16.868389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:16.869149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:16.875296 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.875745 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:16.876562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:16.876991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.047232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:17.056567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4292d6f6-6bb5-437e-90f5-a6c8e6710b39 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.191972 Apr 26 14:12:17.059360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 136/281] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:16 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:17.299415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:17.300102 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:17.306028 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:17.306514 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.307291 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:17.307735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.448147 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:17.456211 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6a32e892-8f1d-4a5c-9725-63605565c242 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.160700 Apr 26 14:12:17.456868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 146/282] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:17 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:17.554573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:17.555263 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:17.561621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:17.562037 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.562831 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:17.563942 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.707141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:17.714710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4af3b05e-7303-4868-b2cd-dc66f8690568 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.164073 Apr 26 14:12:17.715346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 137/283] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:17 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:17.726948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:17.727557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:17.733301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:17.733754 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.734620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:17.735060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:17.871377 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:17.879240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e66f74ef-210c-4b03-8777-6eadee648f25 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1358 microversion: 2.1 time: 0.156085 Apr 26 14:12:17.879796 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 147/284] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:17 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:18.064574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-f12d10fe-5386-4ddc-9509-58385af18817 req-9be44477-8b62-4a34-bc07-3949b9e27bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2e858d-4901-494e-aed1-08b7a3ccda6b", "name": "network-vif-plugged", "status": "completed", "tag": "a222344d-e5e3-4176-8559-d0bda5c36cdd"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:18.075067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:18.080966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-f12d10fe-5386-4ddc-9509-58385af18817 req-9be44477-8b62-4a34-bc07-3949b9e27bd9 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.088573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-f12d10fe-5386-4ddc-9509-58385af18817 req-9be44477-8b62-4a34-bc07-3949b9e27bd9 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.088837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:18.097879 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.098631 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.102207 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.102780 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.113275 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-f12d10fe-5386-4ddc-9509-58385af18817 req-9be44477-8b62-4a34-bc07-3949b9e27bd9 service nova] Creating event network-vif-plugged:a222344d-e5e3-4176-8559-d0bda5c36cdd for instance 8b2e858d-4901-494e-aed1-08b7a3ccda6b on hv-cinder-83513 Apr 26 14:12:18.123307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-f12d10fe-5386-4ddc-9509-58385af18817 req-9be44477-8b62-4a34-bc07-3949b9e27bd9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064734 Apr 26 14:12:18.124468 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 138/285] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:18.181242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e377cb07-b3de-4ee3-85ca-2e3a1a671d80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'create', calling method: .version_select at 0x7f4066dcd670>, body: {"keypair": {"name": "tempest-keypair-876694622"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:18.213883 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-e377cb07-b3de-4ee3-85ca-2e3a1a671d80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:12:18.219048 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-e377cb07-b3de-4ee3-85ca-2e3a1a671d80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for user 706ce393383a460b9b5857f74224a1fa and project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:12:18.290503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:18.299946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-235c7b55-70e7-4cd1-b31d-71038e01711c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.227973 Apr 26 14:12:18.302279 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 148/286] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:18 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:18.465056 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-e377cb07-b3de-4ee3-85ca-2e3a1a671d80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:12:18.469188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-e377cb07-b3de-4ee3-85ca-2e3a1a671d80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for user 706ce393383a460b9b5857f74224a1fa and project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:12:18.476134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:18.476878 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:18.483597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e377cb07-b3de-4ee3-85ca-2e3a1a671d80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.306485 Apr 26 14:12:18.484482 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 139/287] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:12:18 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:18.491371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.491855 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.492629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.493069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.638887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:18.647861 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0918472e-0616-42a8-a800-10131bcb7a30 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.177940 Apr 26 14:12:18.648545 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 149/288] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:18 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:18.732786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:18.733532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:18.739595 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.740041 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.740800 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.741230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.898556 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:18.899218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:18.906426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.906885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.908367 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:18.908810 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:18.918318 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:18.926233 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-408f57f2-72be-4742-8d79-f7931f8ba3f2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.197690 Apr 26 14:12:18.926985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 140/289] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:18 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:19.052060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:19.059365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ef3d4896-32f0-4415-85c4-6826cd85587a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1549 microversion: 2.1 time: 0.165993 Apr 26 14:12:19.059926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 150/290] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:18 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:19.077572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:19.078235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:19.085467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.086006 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.086760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.087198 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.267379 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:19.274613 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-267b22ec-2e48-41dd-9ab3-66a341f65517 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1549 microversion: 2.1 time: 0.200880 Apr 26 14:12:19.275186 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 141/291] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:19 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1549 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:19.291022 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:19.295308 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:19.296164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Searching by: {'deleted': False, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6'} {{(pid=117601) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 26 14:12:19.303233 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.303823 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.304481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.304941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.317497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:19.326155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:19.326155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.326155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.326155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.326523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.397962 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.multi_cell_list [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117601) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 26 14:12:19.497615 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:19.499335 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f9492953-28c3-4b14-af8b-7401baf5b624 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212615 Apr 26 14:12:19.500306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 151/292] 10.222.0.23 () {58 vars in 1124 bytes} [Tue Apr 26 14:12:19 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:19.506004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-92c41652-2aea-41c7-b8ac-aed931edaf36 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1313 microversion: 2.1 time: 0.193135 Apr 26 14:12:19.510944 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:19.511557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:19.515689 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 142/293] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:19 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:19.517546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.518021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.518786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.519218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.663307 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:19.665638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:19.666289 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:19.672449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-57a32500-2ba1-4598-8ef2-28a6fad0894e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1549 microversion: 2.1 time: 0.165170 Apr 26 14:12:19.675359 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.676028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.677234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.678050 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.684927 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 152/294] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:19 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1549 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:19.852413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:19.860920 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1f27ce30-1d7a-43a0-a9c7-ebe29cf1028a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.198568 Apr 26 14:12:19.870444 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 143/295] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:19 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:19.943892 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:19.944624 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:19.950622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.951071 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:19.951841 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:19.952275 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:20.123804 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:20.133064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-89624052-840e-4f21-8dd7-26a53edf000d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.193125 Apr 26 14:12:20.142746 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-b26ffad4-631d-4064-bb3f-8f0bb96f8e96 req-1b44434c-65cc-451b-9518-57a7dbfc486f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df98b23b-b855-4fcd-ab58-771e1f55e22b", "name": "network-vif-plugged", "status": "completed", "tag": "ede1cf67-87e7-4b05-824d-155ba5205045"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:20.144791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 153/296] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:19 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:20.151751 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-b26ffad4-631d-4064-bb3f-8f0bb96f8e96 req-1b44434c-65cc-451b-9518-57a7dbfc486f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:20.152205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-b26ffad4-631d-4064-bb3f-8f0bb96f8e96 req-1b44434c-65cc-451b-9518-57a7dbfc486f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:20.164112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-b26ffad4-631d-4064-bb3f-8f0bb96f8e96 req-1b44434c-65cc-451b-9518-57a7dbfc486f service nova] Creating event network-vif-plugged:ede1cf67-87e7-4b05-824d-155ba5205045 for instance df98b23b-b855-4fcd-ab58-771e1f55e22b on hv-cinder-83513 Apr 26 14:12:20.169292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-b26ffad4-631d-4064-bb3f-8f0bb96f8e96 req-1b44434c-65cc-451b-9518-57a7dbfc486f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031063 Apr 26 14:12:20.170542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 144/297] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:12:20.526181 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:20.526866 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:20.536050 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:20.536599 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:20.539092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:20.539625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:20.683976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:20.691601 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d9370f9a-b5d9-488b-9195-28c2ef73af96 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1496 microversion: 2.1 time: 0.169814 Apr 26 14:12:20.692198 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 154/298] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:20 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1496 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:20.879612 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:20.880310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:20.886616 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:20.887202 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:20.888070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:20.888581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:21.093871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:21.102749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-eac5ca62-afd5-48e7-b82c-574dca2921d2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.227749 Apr 26 14:12:21.103331 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 145/299] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:20 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:21.150539 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:21.151150 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:21.157731 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:21.158213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:21.158985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:21.159422 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:21.292509 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:21.300561 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1f5e04a6-7fc4-4ff1-bf0a-699069389a1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.153780 Apr 26 14:12:21.310702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 155/300] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:21 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:21.358887 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1390538490", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2f88888a-dab3-44ae-957f-4a304598e58f"}], "security_groups": [{"name": "tempest-securitygroup--783071975"}], "key_name": "tempest-keypair-876694622", "user_data": "}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:21.473565 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] validate_networks() for [('2f88888a-dab3-44ae-957f-4a304598e58f', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:12:21.906792 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:12:21.907900 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:12:21.914229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:12:21.914229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:12:21.914229 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:12:21.918360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:21.918878 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:21.919711 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:21.920141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:21.937367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:12:21.941406 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Getting quotas for user 706ce393383a460b9b5857f74224a1fa and project afa3fcb59a274c22bcf1ebcf44211943. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:12:21.952009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:12:21.954284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:12:22.073305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3551d2ed-3866-4b25-84fb-080035d61e80 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.721145 Apr 26 14:12:22.073948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 146/301] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:12:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:12:22.083830 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ec8e6f18-fac5-4212-b5ea-9726155f4ea3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:22.084437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ec8e6f18-fac5-4212-b5ea-9726155f4ea3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:22.120144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:22.121019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:22.128305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:22.128764 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:22.129991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:22.130458 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:22.141469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ec8e6f18-fac5-4212-b5ea-9726155f4ea3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:22.153218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ec8e6f18-fac5-4212-b5ea-9726155f4ea3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1245 microversion: 2.1 time: 0.073144 Apr 26 14:12:22.154292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 156/302] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:22 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1245 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:22.277267 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:22.286042 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-cefeaf16-d451-4d9b-ba8c-8e7f22f45e31 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.170051 Apr 26 14:12:22.286645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 147/303] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:22 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:22.318896 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:22.319510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:22.325676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:22.326321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:22.331268 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:22.331268 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:22.474083 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:22.482061 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9b8558e1-bdbe-4a01-ad49-79e02b311799 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.167842 Apr 26 14:12:22.482623 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 157/304] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:22 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:23.170446 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:23.170992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:23.177399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.177846 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.178669 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.179104 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.239142 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:23.247071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-81fb1e48-5585-47d1-9d8b-37fed48fc14a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1249 microversion: 2.1 time: 0.080451 Apr 26 14:12:23.247626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 148/305] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:23 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:23.302622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:23.303224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:23.309235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.309675 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.310520 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.310949 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.450499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:23.458652 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5d1c12da-9293-4d60-b9dc-300e8a09bd18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.159820 Apr 26 14:12:23.459612 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 158/306] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:23 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:23.502634 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:23.503240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:23.509088 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.509532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.510320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.510754 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.651212 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:23.663669 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-29763bc3-2332-4f97-ad54-ed94faeb8ce9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.166685 Apr 26 14:12:23.664334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 149/307] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:23 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:23.815497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82148e3a-af8e-49d5-a877-a97393aa9784"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:23.816732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:23.822556 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.823055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.823825 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.824255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.947891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:23.948488 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:23.955529 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.955973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.956808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:23.957242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:23.981377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:12:24.357543 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-afb8da8a-4ffc-4b00-929d-a111686cc4b4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 204 len: 0 microversion: 2.1 time: 0.413238 Apr 26 14:12:24.358213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 150/308] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:12:23 2022] DELETE /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 26 14:12:24.364222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:24.368872 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:24.370788 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.371262 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.372125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.372618 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.438993 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:24.447585 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-51115894-939e-439e-bedc-85aab96edc1b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1297 microversion: 2.1 time: 0.087749 Apr 26 14:12:24.447875 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 151/309] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:24 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:24.452586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:24.453382 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:24.460075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.460731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.461290 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.461938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.624411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:24.631495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0c610a3e-6bd9-4abe-95f3-8c5596eb4769 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.820714 Apr 26 14:12:24.632647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 159/310] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:12:23 2022] POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:24.633922 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-24c5a491-0dd7-4e2d-8fd5-5dc9c7c4e0c1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1502 microversion: 2.1 time: 0.184770 Apr 26 14:12:24.634644 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 152/311] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:24 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1502 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:24.638750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:24.639440 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:24.647272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.647809 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.648919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.649361 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.682068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:24.682768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:24.689528 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.690205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.693710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:24.694228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:24.840051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:24.850144 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6c51a935-f1b1-47b9-b56a-1002f9909a3b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1366 microversion: 2.1 time: 0.215480 Apr 26 14:12:24.852232 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 160/312] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:24 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:24.876056 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:24.884129 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a5c58231-2854-4a7a-bf80-c6e382292a86 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.207334 Apr 26 14:12:24.884685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 153/313] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:24 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:25.465983 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:25.466637 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:25.481617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.482096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.482890 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.483313 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.556057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:25.563300 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2fdd8940-b29a-478b-a54d-3be798ace088 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1303 microversion: 2.1 time: 0.102473 Apr 26 14:12:25.563876 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 161/314] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:25 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:25.655548 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:25.656228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:25.664121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.664572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.665362 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.665803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.872653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:25.873359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:25.879777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.880391 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.881152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.881585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.929485 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:25.937010 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-04ddac83-ce2d-45d2-b671-a948fbbe5b78 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1502 microversion: 2.1 time: 0.285759 Apr 26 14:12:25.937583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 154/315] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:25 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:25.942534 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:25.943428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:25.951857 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.953017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:25.955254 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:25.956038 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.036720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:26.046085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8cdfda48-0132-4fbb-acf6-79dc02ce9602 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1556 microversion: 2.1 time: 0.177097 Apr 26 14:12:26.046800 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 162/316] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:25 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1556 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:26.064759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:26.065293 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:26.076718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:26.076718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.076718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:26.076718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.171026 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-30929932-c5cb-48c4-b77a-384f223d808c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111753 Apr 26 14:12:26.171665 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 163/317] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:12:26 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-interface => generated 284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:12:26.173295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:26.182787 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ad0165a1-a1c9-456b-8edf-6732918dfc55 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.243599 Apr 26 14:12:26.186101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 155/318] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:25 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:26.584208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:26.584611 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:26.591270 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:26.591584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.592686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:26.593302 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.954471 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:26.955597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:26.962307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:26.963293 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.964226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:26.964800 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:26.981320 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:26.996212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-75be05e7-0e11-4d5f-b37c-b022466590a0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.419260 Apr 26 14:12:27.010394 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 164/319] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:26 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:27.202968 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:27.203586 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:27.210753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:27.211195 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:27.212437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:27.213217 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:27.247239 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:27.256804 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-217406e8-2023-4ec6-8a26-7f73190f9635 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1502 microversion: 2.1 time: 0.305851 Apr 26 14:12:27.258176 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 156/320] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:26 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1502 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:27.372174 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-fe3b3b62-5ff7-4f67-a110-14d5e717e530 req-79170b85-5d64-4f5d-a49f-6fe2332e0e54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b2e858d-4901-494e-aed1-08b7a3ccda6b", "name": "network-vif-deleted", "tag": "a222344d-e5e3-4176-8559-d0bda5c36cdd"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:27.381593 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fe3b3b62-5ff7-4f67-a110-14d5e717e530 req-79170b85-5d64-4f5d-a49f-6fe2332e0e54 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:27.382151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fe3b3b62-5ff7-4f67-a110-14d5e717e530 req-79170b85-5d64-4f5d-a49f-6fe2332e0e54 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:27.393909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-fe3b3b62-5ff7-4f67-a110-14d5e717e530 req-79170b85-5d64-4f5d-a49f-6fe2332e0e54 service nova] Creating event network-vif-deleted:a222344d-e5e3-4176-8559-d0bda5c36cdd for instance 8b2e858d-4901-494e-aed1-08b7a3ccda6b on hv-cinder-83513 Apr 26 14:12:27.399303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-fe3b3b62-5ff7-4f67-a110-14d5e717e530 req-79170b85-5d64-4f5d-a49f-6fe2332e0e54 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030775 Apr 26 14:12:27.400118 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 157/321] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:12:27.420956 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:27.428849 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-dc611ed0-3ce2-4d4e-8f1e-fffa0b55c216 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.230125 Apr 26 14:12:27.429587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 165/322] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:27 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:28.014196 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:28.015987 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:28.024972 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.025710 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.026859 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.027686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.053214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-6464b379-a390-495b-8bae-42856f8adffe req-4156852a-4ad9-4f7a-9a97-bf187140b3e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df98b23b-b855-4fcd-ab58-771e1f55e22b", "tag": "ede1cf67-87e7-4b05-824d-155ba5205045"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:28.061929 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-6464b379-a390-495b-8bae-42856f8adffe req-4156852a-4ad9-4f7a-9a97-bf187140b3e0 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.062647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-6464b379-a390-495b-8bae-42856f8adffe req-4156852a-4ad9-4f7a-9a97-bf187140b3e0 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.074379 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-6464b379-a390-495b-8bae-42856f8adffe req-4156852a-4ad9-4f7a-9a97-bf187140b3e0 service nova] Creating event network-changed:ede1cf67-87e7-4b05-824d-155ba5205045 for instance df98b23b-b855-4fcd-ab58-771e1f55e22b on hv-cinder-83513 Apr 26 14:12:28.089122 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-6464b379-a390-495b-8bae-42856f8adffe req-4156852a-4ad9-4f7a-9a97-bf187140b3e0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101616 Apr 26 14:12:28.090990 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 158/323] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:28.225352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:28.234248 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f4f53a54-7f0f-4057-9739-3a8ecfae19ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.224248 Apr 26 14:12:28.245738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 166/324] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:28 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:28.275945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:28.276841 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:28.285504 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.286203 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.287151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.288240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.328411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.330134 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.330927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lazy-loading 'fault' on Instance uuid 8b2e858d-4901-494e-aed1-08b7a3ccda6b {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:12:28.416360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:28.428665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2fc36ce6-4aa8-4b3e-98d9-4b7bc4d11aa4 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 200 len: 1303 microversion: 2.1 time: 0.157587 Apr 26 14:12:28.429351 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 159/325] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:28 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 1303 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:28.446629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:28.447204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:28.453510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.454566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.455515 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:28.455955 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:28.622212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:28.631457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-34509226-ad2f-4119-8bd6-a36464ae30a4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.188679 Apr 26 14:12:28.632352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 167/326] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:28 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:29.252286 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:29.253031 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:29.259771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.260230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.261010 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.261445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.395779 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:29.403063 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3938ecb5-d417-4831-8a09-d61d971a8d58 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.155210 Apr 26 14:12:29.403891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 160/327] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:29 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:29.414083 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-c5cfda66-508c-49c8-98ad-85d9a400b565 req-b8960334-558a-46cb-9dac-03859649b631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8e557-0521-4ed6-971f-dfa80ec191c9", "tag": "e48d3e25-6975-41a5-953a-e283cc06a7c3"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:29.423240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-c5cfda66-508c-49c8-98ad-85d9a400b565 req-b8960334-558a-46cb-9dac-03859649b631 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.423790 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-c5cfda66-508c-49c8-98ad-85d9a400b565 req-b8960334-558a-46cb-9dac-03859649b631 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.434916 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-c5cfda66-508c-49c8-98ad-85d9a400b565 req-b8960334-558a-46cb-9dac-03859649b631 service nova] Creating event network-changed:e48d3e25-6975-41a5-953a-e283cc06a7c3 for instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 on hv-cinder-83513 Apr 26 14:12:29.439854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-c5cfda66-508c-49c8-98ad-85d9a400b565 req-b8960334-558a-46cb-9dac-03859649b631 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029553 Apr 26 14:12:29.440671 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 168/328] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:12:29.447266 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:29.447828 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 8b2e858d-4901-494e-aed1-08b7a3ccda6b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:29.463771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.464226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.464998 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.465432 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.481331 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] HTTP exception thrown: Instance 8b2e858d-4901-494e-aed1-08b7a3ccda6b could not be found. Apr 26 14:12:29.482193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Returning 404 to user: Instance 8b2e858d-4901-494e-aed1-08b7a3ccda6b could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:12:29.483158 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-11c28c61-7286-484a-b161-110685742953 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b" status: 404 len: 111 microversion: 2.1 time: 0.040328 Apr 26 14:12:29.483856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 161/329] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:29 2022] GET /compute/v2.1/servers/8b2e858d-4901-494e-aed1-08b7a3ccda6b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:12:29.592182 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1831128660", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "networks": [{"uuid": "1a702bb0-0366-46dc-8d15-e85f42f915e6"}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:29.644022 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] validate_networks() for [('1a702bb0-0366-46dc-8d15-e85f42f915e6', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:12:29.656267 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:29.659610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:29.669480 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.671862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.673268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:29.673767 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:29.877549 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:29.886551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8544adfa-405b-43dd-a4a9-25f980f1e1b8 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1724 microversion: 2.1 time: 0.240475 Apr 26 14:12:29.887197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 162/330] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:29 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:30.172079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:12:30.172646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:12:30.173254 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:12:30.173908 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:12:30.174813 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:12:30.184528 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:30.185088 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:30.186121 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:30.186676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:30.214497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Getting quotas for project e9ba0d67b78f4c59b3d8e1ea5ae2895d. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:12:30.218564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Getting quotas for user 0b6057ad951e418a9d60de92517ae089 and project e9ba0d67b78f4c59b3d8e1ea5ae2895d. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:12:30.229772 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:12:30.232165 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:12:30.347780 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-30106b49-9de1-4aba-a412-c524294c8cc0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760230 Apr 26 14:12:30.348836 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 169/331] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:12:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:12:30.358744 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bc07098e-36c5-4aff-b5c7-51df6a4a0633 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:30.360803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bc07098e-36c5-4aff-b5c7-51df6a4a0633 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:30.419848 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bc07098e-36c5-4aff-b5c7-51df6a4a0633 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:30.421527 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:30.422184 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:30.429238 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:30.430098 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:30.431090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:30.431684 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:30.432541 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bc07098e-36c5-4aff-b5c7-51df6a4a0633 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1214 microversion: 2.1 time: 0.077719 Apr 26 14:12:30.433472 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 163/332] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:30 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:30.578142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:30.592056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-78f5f04e-53df-4eb3-b5bb-9342f69e5658 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.169214 Apr 26 14:12:30.592056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 170/333] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:30 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:30.905845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:30.906597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:30.913641 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:30.914147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:30.914968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:30.915397 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.059834 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:31.068581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-627052cb-82a4-4d89-b38e-10c721c471e3 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1701 microversion: 2.1 time: 0.166926 Apr 26 14:12:31.069208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 164/334] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:30 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1701 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:31.085601 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-293a23ed-2536-463f-bdd0-727c29bc0b3e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:31.091650 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293a23ed-2536-463f-bdd0-727c29bc0b3e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.092030 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293a23ed-2536-463f-bdd0-727c29bc0b3e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.113491 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-293a23ed-2536-463f-bdd0-727c29bc0b3e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Going to try to start instance {{(pid=117601) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 26 14:12:31.338078 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-293a23ed-2536-463f-bdd0-727c29bc0b3e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action" status: 202 len: 0 microversion: 2.1 time: 0.256137 Apr 26 14:12:31.338688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 171/335] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:12:31 2022] POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:12:31.347515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:31.348296 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:31.354734 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.355268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.356151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.356591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.450721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:31.453370 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:31.460956 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.461698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.463092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.463781 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.512732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:31.521004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a5f82d63-cb14-49d2-8133-fa3f7a353fa2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1710 microversion: 2.1 time: 0.177536 Apr 26 14:12:31.521716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 165/336] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:31 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:31.530315 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:31.538791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-874c7233-97b0-4823-8ddd-6bcc6989ed18 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1218 microversion: 2.1 time: 0.092097 Apr 26 14:12:31.539356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 172/337] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:31 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:31.607579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:31.608330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:31.614693 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.615150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.615928 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:31.616367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:31.857612 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:31.866354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2bf89330-6258-49ab-b58c-2e765d08c900 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.262559 Apr 26 14:12:31.867140 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 166/338] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:31 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:32.539891 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:32.540936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:32.547782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:32.548224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:32.549496 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:32.550194 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:32.560599 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:32.564175 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:32.583773 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:32.588723 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:32.589712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:32.590597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:32.672881 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:32.681459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2072705f-b998-474d-b26b-3538bb6eb7ee tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1266 microversion: 2.1 time: 0.129274 Apr 26 14:12:32.682243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 167/339] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:32 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:32.877928 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:32.883608 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:32.884312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:32.886404 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-43e6a3ca-d818-47ca-a27b-2fc4b728b62f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1710 microversion: 2.1 time: 0.351173 Apr 26 14:12:32.890387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:32.891570 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:32.892908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:32.893397 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:32.897176 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 173/340] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:32 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1710 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:33.325082 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:33.334985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0430bb87-4090-47b6-b0db-a3ad39b71358 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.455190 Apr 26 14:12:33.345327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 168/341] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:32 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:33.467246 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:33.467845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:33.473660 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:33.474134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:33.474900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:33.475423 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:33.656221 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:33.664989 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5945ed14-0fc7-45ac-aa36-e868efdf2038 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1595 microversion: 2.1 time: 0.201430 Apr 26 14:12:33.665573 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 174/342] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:33 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1595 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:33.698816 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:33.699482 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:33.706368 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:33.706854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:33.707784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:33.708409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:33.847733 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:33.858024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-657d305d-2643-439f-85c0-326227652c4a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1272 microversion: 2.1 time: 0.162755 Apr 26 14:12:33.858988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 169/343] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:33 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:33.904882 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:33.908043 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:33.915517 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:33.916183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:33.917122 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:33.917906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:34.018417 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-fc874b96-76ec-479a-9568-0d823a169d72 req-77e6975f-20f1-4e8e-ae80-f9044fa19d04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8e557-0521-4ed6-971f-dfa80ec191c9", "name": "network-vif-plugged", "status": "completed", "tag": "e48d3e25-6975-41a5-953a-e283cc06a7c3"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:34.026350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fc874b96-76ec-479a-9568-0d823a169d72 req-77e6975f-20f1-4e8e-ae80-f9044fa19d04 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:34.026866 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fc874b96-76ec-479a-9568-0d823a169d72 req-77e6975f-20f1-4e8e-ae80-f9044fa19d04 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:34.039910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-fc874b96-76ec-479a-9568-0d823a169d72 req-77e6975f-20f1-4e8e-ae80-f9044fa19d04 service nova] Creating event network-vif-plugged:e48d3e25-6975-41a5-953a-e283cc06a7c3 for instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 on hv-cinder-83513 Apr 26 14:12:34.045068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-fc874b96-76ec-479a-9568-0d823a169d72 req-77e6975f-20f1-4e8e-ae80-f9044fa19d04 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032180 Apr 26 14:12:34.046023 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 170/344] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:12:34.101532 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:34.109441 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e56b435f-7260-4e14-9000-9277935aba30 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1714 microversion: 2.1 time: 0.208440 Apr 26 14:12:34.110619 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 175/345] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:33 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1714 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:34.353626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:34.355365 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:34.362881 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:34.363353 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:34.364337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:34.364772 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:34.690270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:34.698898 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-836e806a-24be-4025-93d4-f0aff700dfe9 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.350159 Apr 26 14:12:34.699527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 171/346] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:34 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:34.877653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:34.878320 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:34.885307 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:34.885755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:34.886685 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:34.887118 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:35.153549 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:35.161603 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5668cc9c-8149-45ca-8697-3f437f10d34e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.289484 Apr 26 14:12:35.162292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 176/347] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:34 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:35.536916 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-406a3504-28e4-4991-bf93-faf93e2dca7a req-448b40a8-47a6-40c2-b45c-57a89d788a07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "922e5811-6f44-4e16-af28-17c19a49af8c", "tag": "f1cae303-f76e-42e6-b766-8cce9e4d7be2"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:35.546991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-406a3504-28e4-4991-bf93-faf93e2dca7a req-448b40a8-47a6-40c2-b45c-57a89d788a07 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:35.547442 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-406a3504-28e4-4991-bf93-faf93e2dca7a req-448b40a8-47a6-40c2-b45c-57a89d788a07 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:35.562079 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-406a3504-28e4-4991-bf93-faf93e2dca7a req-448b40a8-47a6-40c2-b45c-57a89d788a07 service nova] Creating event network-changed:f1cae303-f76e-42e6-b766-8cce9e4d7be2 for instance 922e5811-6f44-4e16-af28-17c19a49af8c on hv-cinder-83513 Apr 26 14:12:35.567583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-406a3504-28e4-4991-bf93-faf93e2dca7a req-448b40a8-47a6-40c2-b45c-57a89d788a07 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034760 Apr 26 14:12:35.568170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 172/348] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:35.715057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:35.715673 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:35.721723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:35.722437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:35.723212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:35.723643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:36.038057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:36.049056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-89d99500-d507-42a2-bc2f-de4ce77dfb2f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1370 microversion: 2.1 time: 0.337624 Apr 26 14:12:36.078116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 177/349] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:35 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1370 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:36.179404 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:36.180099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:36.186694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:36.187147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:36.187988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:36.188425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:36.460771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:36.469788 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c8719ff4-e72c-4092-b953-14edcb16d54e tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.293982 Apr 26 14:12:36.479163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 173/350] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:36 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:36.594819 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-283c119b-bcaa-4df9-9c88-9acdc1ff3cf5 req-6eedc0f5-6239-4329-83b1-0f1524cddba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:36.605727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-283c119b-bcaa-4df9-9c88-9acdc1ff3cf5 req-6eedc0f5-6239-4329-83b1-0f1524cddba9 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:36.606447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-283c119b-bcaa-4df9-9c88-9acdc1ff3cf5 req-6eedc0f5-6239-4329-83b1-0f1524cddba9 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:36.624853 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-283c119b-bcaa-4df9-9c88-9acdc1ff3cf5 req-6eedc0f5-6239-4329-83b1-0f1524cddba9 service nova] Creating event network-changed:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:12:36.630685 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-283c119b-bcaa-4df9-9c88-9acdc1ff3cf5 req-6eedc0f5-6239-4329-83b1-0f1524cddba9 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040866 Apr 26 14:12:36.632334 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 178/351] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:37.067270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:37.067955 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:37.074232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:37.074871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:37.075597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:37.076033 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:37.300892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:37.309205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-38c7d457-2f1f-4ff3-be6c-99535ae215c6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1563 microversion: 2.1 time: 0.246702 Apr 26 14:12:37.321248 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 174/352] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:37 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1563 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:37.330419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:37.331005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:37.338081 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:37.338534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:37.339426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:37.339856 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:37.478680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1524c6c4-ae79-4096-932c-51a38e7b89bb tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.152437 Apr 26 14:12:37.482003 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 179/353] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:12:37 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:37.495274 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:37.496204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:37.503712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:37.507473 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:37.507473 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:37.507473 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:37.821607 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:37.832099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-965ab080-20f9-41a2-881b-010a9331f3b1 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.339254 Apr 26 14:12:37.832099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 175/354] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:37 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:38.849759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:38.850415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:38.866180 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:38.866672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:38.868703 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:38.869150 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:38.943224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-1cee4202-36e1-4b87-881e-b91cb630e7bf req-0beed7c0-65f1-4b93-8ba6-ce2f8a80aa7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8e557-0521-4ed6-971f-dfa80ec191c9", "tag": "e48d3e25-6975-41a5-953a-e283cc06a7c3"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:38.951338 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-1cee4202-36e1-4b87-881e-b91cb630e7bf req-0beed7c0-65f1-4b93-8ba6-ce2f8a80aa7e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:38.951862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-1cee4202-36e1-4b87-881e-b91cb630e7bf req-0beed7c0-65f1-4b93-8ba6-ce2f8a80aa7e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:38.965038 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-1cee4202-36e1-4b87-881e-b91cb630e7bf req-0beed7c0-65f1-4b93-8ba6-ce2f8a80aa7e service nova] Creating event network-changed:e48d3e25-6975-41a5-953a-e283cc06a7c3 for instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 on hv-cinder-83513 Apr 26 14:12:38.969576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-1cee4202-36e1-4b87-881e-b91cb630e7bf req-0beed7c0-65f1-4b93-8ba6-ce2f8a80aa7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031980 Apr 26 14:12:38.970779 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 176/355] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:39.086546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:39.109097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e4420546-4dff-4e49-ba9b-b595bdc57ed0 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.253481 Apr 26 14:12:39.109097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 180/356] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:38 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:39.854544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-11990393"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:39.855476 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:39.863351 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:39.868933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:39.868933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:39.868933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:40.054828 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.network.security_group_api [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Adding security group ad8b00a7-ca9f-4274-b3b7-d02ea0c017c2 to port abcf92b7-d4b6-41b9-80c4-6fbda749a755 Apr 26 14:12:40.115853 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:40.117216 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:40.123400 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:40.123847 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:40.124841 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:40.125312 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:40.299317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:40.306842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-877e7be8-50bc-47df-a526-a210b1d3c06a tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.195747 Apr 26 14:12:40.317248 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 181/357] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:40 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:40.613850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-de6f2d7d-91ca-4128-9f16-2b5113903b90 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/action" status: 202 len: 0 microversion: 2.1 time: 0.763516 Apr 26 14:12:40.616303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 177/358] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:12:39 2022] POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/action => generated 0 bytes in 766 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:12:40.622856 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:40.623458 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:40.631396 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:40.632343 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:40.635507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:40.636143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:40.816846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:40.825461 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-14b03017-edb3-4ef4-947e-e0e22a630779 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1759 microversion: 2.1 time: 0.206364 Apr 26 14:12:40.826064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 182/359] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:40 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1759 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:40.992197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-6e8eff78-dbc0-4459-a047-40f156951cac req-c6124993-4203-45da-ac99-38093b494dac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:41.001071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-6e8eff78-dbc0-4459-a047-40f156951cac req-c6124993-4203-45da-ac99-38093b494dac service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:41.001598 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-6e8eff78-dbc0-4459-a047-40f156951cac req-c6124993-4203-45da-ac99-38093b494dac service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:41.013452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-6e8eff78-dbc0-4459-a047-40f156951cac req-c6124993-4203-45da-ac99-38093b494dac service nova] Creating event network-changed:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:12:41.019539 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-6e8eff78-dbc0-4459-a047-40f156951cac req-c6124993-4203-45da-ac99-38093b494dac service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031320 Apr 26 14:12:41.022594 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 178/360] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:41.325067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:41.325821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:41.333648 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:41.334239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:41.335318 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:41.335859 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:41.487185 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:41.494527 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1a912daf-b702-4833-af99-568de27a5d70 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.173749 Apr 26 14:12:41.495177 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 183/361] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:41 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:12:41.957048 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-93351af9-bf1e-4db3-a4fb-dbc661b37694 req-b613391d-f9ac-4fe7-8955-bd4df06898f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922e5811-6f44-4e16-af28-17c19a49af8c", "name": "network-vif-plugged", "status": "completed", "tag": "f1cae303-f76e-42e6-b766-8cce9e4d7be2"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:41.966176 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-93351af9-bf1e-4db3-a4fb-dbc661b37694 req-b613391d-f9ac-4fe7-8955-bd4df06898f1 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:41.966625 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-93351af9-bf1e-4db3-a4fb-dbc661b37694 req-b613391d-f9ac-4fe7-8955-bd4df06898f1 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:41.977142 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-93351af9-bf1e-4db3-a4fb-dbc661b37694 req-b613391d-f9ac-4fe7-8955-bd4df06898f1 service nova] Creating event network-vif-plugged:f1cae303-f76e-42e6-b766-8cce9e4d7be2 for instance 922e5811-6f44-4e16-af28-17c19a49af8c on hv-cinder-83513 Apr 26 14:12:41.982092 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-93351af9-bf1e-4db3-a4fb-dbc661b37694 req-b613391d-f9ac-4fe7-8955-bd4df06898f1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Apr 26 14:12:41.982660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 179/362] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:42.511855 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:42.512395 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:42.519136 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:42.519575 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:42.520361 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:42.520788 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:42.650799 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:42.658468 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-44f9227d-491b-41ab-921f-0a09b3a3e80c tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.150684 Apr 26 14:12:42.664049 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 184/363] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:42 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:43.675771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:43.676386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:43.682349 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:43.682802 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:43.683574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:43.684008 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:43.826533 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:43.835231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3e284494-3bf8-4f98-a000-846d70465a82 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1314 microversion: 2.1 time: 0.164196 Apr 26 14:12:43.835805 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 180/364] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:43 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:44.852364 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:44.853024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:44.859435 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:44.863682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:44.863682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:44.863682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:45.002286 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:45.009717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2661dab9-7f05-48b4-bee4-91b596f76fff tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1497 microversion: 2.1 time: 0.161507 Apr 26 14:12:45.010303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 185/365] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:44 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:45.911982 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:45.913886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:45.919143 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:45.919616 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:45.920415 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:45.920844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:45.954052 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:12:46.262071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e86bf072-2084-48b7-bc33-0216385dbaf9 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "DELETE /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 204 len: 0 microversion: 2.1 time: 0.351626 Apr 26 14:12:46.262071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 181/366] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:12:45 2022] DELETE /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:12:46.269262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:46.269874 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:46.276264 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:46.276713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:46.277476 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:46.277914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:46.410260 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:46.417815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fcf870d4-ebc2-4764-af5d-6368839c91d8 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1503 microversion: 2.1 time: 0.152876 Apr 26 14:12:46.418408 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 186/367] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:46 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:47.435642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:47.436344 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:47.442837 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:47.443274 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:47.444052 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:47.444487 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:47.580185 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:47.587401 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-58163a1f-4efb-4a23-9339-56d1e549be75 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1503 microversion: 2.1 time: 0.156187 Apr 26 14:12:47.587951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 182/368] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:47 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:48.608339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:48.608939 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:48.615151 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:48.615591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:48.616338 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:48.616761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:48.748755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:48.756153 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ae8698c7-a9c1-4322-8b47-9a524023f1fd tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1503 microversion: 2.1 time: 0.151468 Apr 26 14:12:48.756459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 187/369] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:48 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:49.289070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-2a2511af-4ebc-422b-8cde-79dec6ad12db req-87d4051f-5abf-4826-9535-40e5c4815c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "922e5811-6f44-4e16-af28-17c19a49af8c", "name": "network-vif-deleted", "tag": "f1cae303-f76e-42e6-b766-8cce9e4d7be2"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:12:49.297164 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-2a2511af-4ebc-422b-8cde-79dec6ad12db req-87d4051f-5abf-4826-9535-40e5c4815c0f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:49.297611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-2a2511af-4ebc-422b-8cde-79dec6ad12db req-87d4051f-5abf-4826-9535-40e5c4815c0f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:49.308842 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-2a2511af-4ebc-422b-8cde-79dec6ad12db req-87d4051f-5abf-4826-9535-40e5c4815c0f service nova] Creating event network-vif-deleted:f1cae303-f76e-42e6-b766-8cce9e4d7be2 for instance 922e5811-6f44-4e16-af28-17c19a49af8c on hv-cinder-83513 Apr 26 14:12:49.315270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-2a2511af-4ebc-422b-8cde-79dec6ad12db req-87d4051f-5abf-4826-9535-40e5c4815c0f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029225 Apr 26 14:12:49.316077 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 183/370] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:12:49.772718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:49.773429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:49.779554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:49.780078 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:49.780851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:49.781284 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:49.812897 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:49.813514 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:49.823094 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lazy-loading 'fault' on Instance uuid 922e5811-6f44-4e16-af28-17c19a49af8c {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:12:49.856906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b6057ad951e418a9d60de92517ae089', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9ba0d67b78f4c59b3d8e1ea5ae2895d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:12:49.864894 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-df807cad-3b81-4bbe-bf83-704cfd9979dc tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 200 len: 1304 microversion: 2.1 time: 0.096138 Apr 26 14:12:49.865456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 188/371] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:49 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:12:50.882295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:12:50.883015 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] [instance: 922e5811-6f44-4e16-af28-17c19a49af8c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:12:50.890374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:50.890880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:50.891660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:12:50.892100 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:12:50.905227 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] HTTP exception thrown: Instance 922e5811-6f44-4e16-af28-17c19a49af8c could not be found. Apr 26 14:12:50.905824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] Returning 404 to user: Instance 922e5811-6f44-4e16-af28-17c19a49af8c could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:12:50.906689 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-28ab0472-9b2f-41e9-9dc0-7dcfc0fe6202 tempest-VolumesActionsTest-1478789785 tempest-VolumesActionsTest-1478789785-project] 10.222.0.23 "GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c" status: 404 len: 111 microversion: 2.1 time: 0.029480 Apr 26 14:12:50.907235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 184/372] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:12:50 2022] GET /compute/v2.1/servers/922e5811-6f44-4e16-af28-17c19a49af8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:13:03.699640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-838723874", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:03.767336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] validate_networks() for None {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:13:04.060535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:13:04.060953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:13:04.061449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:13:04.061857 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:13:04.062292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:13:04.072721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:04.073485 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:04.074503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:04.074940 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:04.091511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Getting quotas for project 2fef6b53f8794ce3acf225bc18f41292. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:13:04.095566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Getting quotas for user 10bd3833ec1248d9abdf96a9a4a25af0 and project 2fef6b53f8794ce3acf225bc18f41292. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:13:04.106797 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:13:04.109057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:13:04.246623 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-cd31e051-1fe7-46b0-92d0-e6ef445acec6 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551045 Apr 26 14:13:04.247432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 189/373] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:13:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:13:04.257883 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-dfbcc39b-6fd7-4080-9e0b-288fe43a5f98 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:04.258500 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-dfbcc39b-6fd7-4080-9e0b-288fe43a5f98 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:04.315542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-dfbcc39b-6fd7-4080-9e0b-288fe43a5f98 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:04.323967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-dfbcc39b-6fd7-4080-9e0b-288fe43a5f98 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1214 microversion: 2.1 time: 0.070492 Apr 26 14:13:04.331972 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 185/374] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:04 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:05.342163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e1b650e7-049c-4d7c-b6d3-97fc8e0b78b5 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:05.342881 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e1b650e7-049c-4d7c-b6d3-97fc8e0b78b5 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:05.396268 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e1b650e7-049c-4d7c-b6d3-97fc8e0b78b5 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:05.406723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e1b650e7-049c-4d7c-b6d3-97fc8e0b78b5 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1214 microversion: 2.1 time: 0.068914 Apr 26 14:13:05.407295 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 190/375] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:05 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:06.424497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:06.425284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:06.432292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:06.432739 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:06.433522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:06.434207 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:06.501771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:06.510968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-612fb1c0-fc5d-467d-9215-55a80dab5b6e tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1266 microversion: 2.1 time: 0.090287 Apr 26 14:13:06.511572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 186/376] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:06 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:07.529091 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:07.530897 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:07.539779 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:07.540633 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:07.541820 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:07.542752 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:07.632471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:07.642303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4b282c77-aba6-45a0-b9a5-c6a4bb913ad8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1272 microversion: 2.1 time: 0.117542 Apr 26 14:13:07.643725 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 191/377] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:07 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1272 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:08.666840 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:08.666840 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:08.674631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:08.674631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:08.675055 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:08.675551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:08.940749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:08.949645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f53683d2-c227-44ec-9e4d-42036a220975 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.293531 Apr 26 14:13:08.950848 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 187/378] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:08 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:09.087834 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-5f106ac4-3b92-4453-8d2c-55ad25c82a92 req-c4d0545e-d125-4b5e-9895-7a6ba01df1ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e6a1421-0bd4-4712-9303-3999459f79a7", "tag": "ea41d532-9318-490f-81b6-82e2435de747"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:09.104265 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-5f106ac4-3b92-4453-8d2c-55ad25c82a92 req-c4d0545e-d125-4b5e-9895-7a6ba01df1ca service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:09.106926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-5f106ac4-3b92-4453-8d2c-55ad25c82a92 req-c4d0545e-d125-4b5e-9895-7a6ba01df1ca service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:09.120007 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-5f106ac4-3b92-4453-8d2c-55ad25c82a92 req-c4d0545e-d125-4b5e-9895-7a6ba01df1ca service nova] Creating event network-changed:ea41d532-9318-490f-81b6-82e2435de747 for instance 4e6a1421-0bd4-4712-9303-3999459f79a7 on hv-cinder-83513 Apr 26 14:13:09.135487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-5f106ac4-3b92-4453-8d2c-55ad25c82a92 req-c4d0545e-d125-4b5e-9895-7a6ba01df1ca service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051450 Apr 26 14:13:09.139761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 192/379] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:13:09.968160 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:09.969412 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:09.986032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:09.986568 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:09.988061 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:09.989153 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:10.195199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:10.209673 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a561d1b5-722f-4867-986b-f79dae379b65 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.245758 Apr 26 14:13:10.211386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 188/380] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:09 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:11.227211 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:11.228618 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:11.234777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:11.235218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:11.235977 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:11.236406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:11.381997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:11.389569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b3a2733e-1ec4-439c-9a1c-e3f89e4970aa tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.166975 Apr 26 14:13:11.390571 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 193/381] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:11 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:12.406491 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:12.407091 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:12.414205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:12.414656 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:12.415431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:12.415864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:12.578391 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:12.586081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8b29cf46-161d-4fc0-8361-7711777529a8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.183806 Apr 26 14:13:12.586651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 189/382] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:12 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:13.602904 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:13.603508 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:13.609776 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:13.610249 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:13.611010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:13.611442 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:13.739558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:13.746733 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f10164b5-5152-4b0f-9c15-50323832f9b2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.147735 Apr 26 14:13:13.747289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 194/383] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:13 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:14.764203 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:14.765183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:14.771730 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:14.772183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:14.772957 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:14.773395 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:14.908362 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:14.916545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8a10244a-b1fc-4a89-8f0b-b50ae096ed75 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.156362 Apr 26 14:13:14.917102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 190/384] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:14 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:15.932970 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:15.933512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:15.939697 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:15.940142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:15.940896 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:15.941324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:16.074940 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:16.082154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8bc15984-cee4-4622-b89b-ed7012e60af7 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.153459 Apr 26 14:13:16.082743 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 195/385] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:15 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:16.088838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-029c0e62-3059-4658-85ae-045b4c4d8251 req-040ec858-6a52-41b2-9b3b-38c4c947bf81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6a1421-0bd4-4712-9303-3999459f79a7", "name": "network-vif-plugged", "status": "completed", "tag": "ea41d532-9318-490f-81b6-82e2435de747"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:16.099082 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-029c0e62-3059-4658-85ae-045b4c4d8251 req-040ec858-6a52-41b2-9b3b-38c4c947bf81 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:16.099522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-029c0e62-3059-4658-85ae-045b4c4d8251 req-040ec858-6a52-41b2-9b3b-38c4c947bf81 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:16.109890 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-029c0e62-3059-4658-85ae-045b4c4d8251 req-040ec858-6a52-41b2-9b3b-38c4c947bf81 service nova] Creating event network-vif-plugged:ea41d532-9318-490f-81b6-82e2435de747 for instance 4e6a1421-0bd4-4712-9303-3999459f79a7 on hv-cinder-83513 Apr 26 14:13:16.115377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-029c0e62-3059-4658-85ae-045b4c4d8251 req-040ec858-6a52-41b2-9b3b-38c4c947bf81 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030097 Apr 26 14:13:16.115957 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 191/386] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:17.098381 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:17.098986 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:17.107296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:17.107739 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:17.108504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:17.108932 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:17.334172 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:17.341676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-498fbe79-ffee-490d-bdbd-ddaef6c79c2a tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1314 microversion: 2.1 time: 0.247089 Apr 26 14:13:17.342271 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 196/387] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:17 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:18.359955 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:18.360669 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:18.366576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:18.367022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:18.367777 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:18.368206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:18.501090 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:18.508993 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6a4d00c4-93de-40b7-a511-a08bc40508b8 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1464 microversion: 2.1 time: 0.153673 Apr 26 14:13:18.509637 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 192/388] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:18 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:18.554056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:18.554841 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:18.561005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:18.561441 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:18.562220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:18.562650 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:18.587184 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:13:18.945255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7f7743db-4e51-4212-8672-02c9ef2bf6a2 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "DELETE /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 204 len: 0 microversion: 2.1 time: 0.395215 Apr 26 14:13:18.945934 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 197/389] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:13:18 2022] DELETE /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:13:18.953942 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:18.954670 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:18.960453 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:18.960899 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:18.961669 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:18.962140 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:19.095048 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:19.102877 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e3ed5d5e-660e-409f-bcef-4f7e14ea9184 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1470 microversion: 2.1 time: 0.152769 Apr 26 14:13:19.103675 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 193/390] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:18 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:20.120761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:20.121346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:20.127908 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:20.128350 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:20.129109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:20.141043 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:20.264517 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:20.272441 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-28396597-0f3c-4052-ae90-cb917dfaf058 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1470 microversion: 2.1 time: 0.156198 Apr 26 14:13:20.273005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 198/391] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:20 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1470 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:20.713040 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:20.714564 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:20.722131 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:20.722579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:20.723347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:20.723800 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:21.000121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1b491f41-2c65-4019-955f-2f985b5db013 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/action" status: 202 len: 0 microversion: 2.1 time: 0.291905 Apr 26 14:13:21.000925 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 194/392] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:13:20 2022] POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:13:21.009941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:21.010695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:21.019886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:21.020590 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:21.021367 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:21.022608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:21.161390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-5e345c3e-9f1a-4ce1-b890-5034f7ba0055 req-15cf41ae-bdb3-40ac-842e-0c38c5c082fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e6a1421-0bd4-4712-9303-3999459f79a7", "name": "network-vif-deleted", "tag": "ea41d532-9318-490f-81b6-82e2435de747"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:21.170042 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5e345c3e-9f1a-4ce1-b890-5034f7ba0055 req-15cf41ae-bdb3-40ac-842e-0c38c5c082fc service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:21.170488 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5e345c3e-9f1a-4ce1-b890-5034f7ba0055 req-15cf41ae-bdb3-40ac-842e-0c38c5c082fc service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:21.191724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-5e345c3e-9f1a-4ce1-b890-5034f7ba0055 req-15cf41ae-bdb3-40ac-842e-0c38c5c082fc service nova] Creating event network-vif-deleted:ea41d532-9318-490f-81b6-82e2435de747 for instance 4e6a1421-0bd4-4712-9303-3999459f79a7 on hv-cinder-83513 Apr 26 14:13:21.196863 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-5e345c3e-9f1a-4ce1-b890-5034f7ba0055 req-15cf41ae-bdb3-40ac-842e-0c38c5c082fc service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039703 Apr 26 14:13:21.197915 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 195/393] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:13:21.212548 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:21.222065 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-135aa084-2675-48c6-beee-bd957c35c05f tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1751 microversion: 2.1 time: 0.216297 Apr 26 14:13:21.222646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 199/394] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:21 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1751 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:21.290158 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:21.290891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:21.297557 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:21.298119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:21.299799 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:21.300401 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:21.377199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10bd3833ec1248d9abdf96a9a4a25af0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fef6b53f8794ce3acf225bc18f41292', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:21.385350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5822e2f5-1dfb-4ac8-b880-194e424da210 tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 200 len: 1299 microversion: 2.1 time: 0.099863 Apr 26 14:13:21.385872 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 196/395] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:21 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:22.245231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:22.245820 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:22.252111 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:22.252539 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:22.253289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:22.253715 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:22.400454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:22.402799 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:22.403476 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] [instance: 4e6a1421-0bd4-4712-9303-3999459f79a7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:22.408255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-21c08149-86e4-411d-b39a-2876c4a4dcee tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.166920 Apr 26 14:13:22.408902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 200/396] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:22 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:22.409879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:22.410372 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:22.411137 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:22.411566 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:22.424694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] HTTP exception thrown: Instance 4e6a1421-0bd4-4712-9303-3999459f79a7 could not be found. Apr 26 14:13:22.425741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] Returning 404 to user: Instance 4e6a1421-0bd4-4712-9303-3999459f79a7 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:13:22.426580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-99116273-d963-4162-affe-69f326836ddd tempest-VolumesNegativeTest-1000160599 tempest-VolumesNegativeTest-1000160599-project] 10.222.0.23 "GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7" status: 404 len: 111 microversion: 2.1 time: 0.027916 Apr 26 14:13:22.427441 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 197/397] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:22 2022] GET /compute/v2.1/servers/4e6a1421-0bd4-4712-9303-3999459f79a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:13:23.163349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:23.163838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:23.170187 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:23.170632 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:23.171425 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:23.171860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:23.193826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3676a7a2-e1af-4b4b-ad0b-0367e4abd13a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/ips" status: 200 len: 150 microversion: 2.1 time: 0.035229 Apr 26 14:13:23.194469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 201/398] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:13:23 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:23.428286 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:23.428897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:23.435543 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:23.435994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:23.436909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:23.437347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:23.613583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:23.621519 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bd880621-49be-460a-81e3-2f62038b5e31 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.196959 Apr 26 14:13:23.622418 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 198/399] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:23 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:24.638486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:24.639097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:24.645586 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:24.646052 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:24.646837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:24.647257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:24.793710 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:24.801674 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a7bfe7d0-88da-4c3a-ab98-912c6882e866 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.167109 Apr 26 14:13:24.802260 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 202/400] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:24 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:25.045895 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b64902d5-736a-4f0d-a35b-ef04f3590397"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:25.046971 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:25.053219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:25.053667 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:25.054449 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:25.054882 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:25.819573 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:25.820114 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:25.826397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:25.826846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:25.827605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:25.828085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:25.915249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4dc39a86-9524-45dd-835a-f2f962b3d7ca tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.873052 Apr 26 14:13:25.915864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 199/401] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:13:25 2022] POST /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:26.000873 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:26.010060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3df891fd-8b64-4600-9f7a-e324adba9401 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.194833 Apr 26 14:13:26.010628 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 203/402] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:25 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:27.027736 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:27.028442 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:27.034687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:27.035144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:27.036532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:27.037119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:27.195940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:27.202354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9b78ec5f-1df0-4312-8d21-316d55f3371e tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.179321 Apr 26 14:13:27.202912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 200/403] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:27 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:28.222512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:28.222963 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:28.228935 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:28.229385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:28.230189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:28.230629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:28.378450 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:28.386826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bdfce1e8-5b61-4175-848a-d7f3260e5806 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.168622 Apr 26 14:13:28.387393 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 204/404] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:28 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:29.404277 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:29.404888 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:29.411149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:29.411590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:29.412359 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:29.412791 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:29.571759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:29.579475 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fe57aaea-8a0c-431b-87cd-d50a826aee21 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.179008 Apr 26 14:13:29.580046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 201/405] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:29 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:30.603719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:30.603719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:30.605311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:30.605755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:30.606544 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:30.607004 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:30.761222 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:30.769012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5221072b-3487-49c3-abde-9a1f88eb0f40 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.176248 Apr 26 14:13:30.773413 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 205/406] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:30 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:31.787050 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:31.787661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:31.794540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:31.795030 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:31.795796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:31.796224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:31.942811 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:31.950515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1996edff-aab7-452d-b264-6ded746e9d7a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.167751 Apr 26 14:13:31.951078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 202/407] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:31 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:32.968392 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:32.968918 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:32.975236 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:32.975686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:32.979806 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:32.979806 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:33.122971 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:33.130990 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bd46b866-8ee2-4773-ac5e-e6c7033d03a0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.166636 Apr 26 14:13:33.137200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 206/408] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:32 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:33.221072 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:33.221614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:33.228154 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:33.228659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:33.229422 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:33.229853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:33.349349 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lazy-loading 'services' on Instance uuid feac5dcc-29a9-415d-9898-564338c394d0 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:13:33.450247 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-674363325", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "networks": [{"uuid": "7a9cd801-4fa3-4614-975b-7aad7bd70432"}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:33.504567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] validate_networks() for [('7a9cd801-4fa3-4614-975b-7aad7bd70432', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:13:33.653029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-78f7f471-67fe-4f56-bef2-ed948d30b742 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-volume_attachments/93f2bbec-5c6d-4e9c-aa1b-3e0db3d669d0" status: 202 len: 0 microversion: 2.1 time: 0.435868 Apr 26 14:13:33.654680 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 203/409] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:13:33 2022] DELETE /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-volume_attachments/93f2bbec-5c6d-4e9c-aa1b-3e0db3d669d0 => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:13:33.662350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8789395b-fe52-43f5-9fd6-756eede41c41 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: .version_select at 0x7f4066d47940>, body: {"keypair": {"name": "tempest-keypair-1870176890"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:33.681386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-8789395b-fe52-43f5-9fd6-756eede41c41 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:13:33.685330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-8789395b-fe52-43f5-9fd6-756eede41c41 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:13:33.858115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:13:33.858115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:13:33.858115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:13:33.858115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:13:33.858115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:13:33.860252 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:33.860691 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-8789395b-fe52-43f5-9fd6-756eede41c41 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:13:33.860815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:33.861484 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:33.861998 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:33.864340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-8789395b-fe52-43f5-9fd6-756eede41c41 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:13:33.876919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8789395b-fe52-43f5-9fd6-756eede41c41 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.220944 Apr 26 14:13:33.877513 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 204/410] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:13:33 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:33.879645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Getting quotas for project 044c341dbfb24ed2812bc91e85e6b06a. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:13:33.884013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Getting quotas for user 434acf8f6a44484189c95c3504418e20 and project 044c341dbfb24ed2812bc91e85e6b06a. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:13:33.895024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:13:33.897301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:13:34.032277 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6d9b340d-6cca-40b7-83c2-317be95694bb tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598016 Apr 26 14:13:34.038855 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 207/411] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 26 14:13:34.043715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e806f87a-5ea0-4899-b7e0-8dbaf4653509 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:34.044454 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e806f87a-5ea0-4899-b7e0-8dbaf4653509 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:34.095604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e806f87a-5ea0-4899-b7e0-8dbaf4653509 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:34.102828 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e806f87a-5ea0-4899-b7e0-8dbaf4653509 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1218 microversion: 2.1 time: 0.062951 Apr 26 14:13:34.103447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 205/412] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:34 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1218 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:34.149228 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:34.149840 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:34.157757 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:34.157757 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:34.157757 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:34.158116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:34.311228 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:34.319365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-14f4ade4-e9c3-411a-9d29-e97f41ce5e1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.174006 Apr 26 14:13:34.319932 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 208/413] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:34 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:35.120202 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0044e2d8-e4ea-4bb7-b924-2ab3e5284f28 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:35.120818 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0044e2d8-e4ea-4bb7-b924-2ab3e5284f28 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:35.174099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0044e2d8-e4ea-4bb7-b924-2ab3e5284f28 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:35.182251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0044e2d8-e4ea-4bb7-b924-2ab3e5284f28 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1218 microversion: 2.1 time: 0.065870 Apr 26 14:13:35.182822 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 206/414] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:35 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:35.336801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:35.337385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:35.343915 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:35.344587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:35.345374 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:35.345799 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:35.495427 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:35.503622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0c9d3559-1336-4a9a-9752-ca8befd45776 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.170817 Apr 26 14:13:35.504371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 209/415] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:35 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:35.725743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bba9c4dc-db04-48b1-983b-4f3226749dff"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:35.726957 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:35.733037 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:35.733578 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:35.734451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:35.734987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:35.823996 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-73dc3e36-1b81-4f6f-b81f-77a5703c5bbc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:35.830579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-73dc3e36-1b81-4f6f-b81f-77a5703c5bbc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:35.838535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-73dc3e36-1b81-4f6f-b81f-77a5703c5bbc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:35.861697 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-73dc3e36-1b81-4f6f-b81f-77a5703c5bbc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Going to try to stop instance {{(pid=117601) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 26 14:13:36.132107 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-73dc3e36-1b81-4f6f-b81f-77a5703c5bbc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action" status: 202 len: 0 microversion: 2.1 time: 0.312027 Apr 26 14:13:36.136009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 210/416] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:13:35 2022] POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:13:36.141211 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:36.142262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:36.150307 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:36.150760 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:36.151567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:36.152015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:36.289063 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:36.296236 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3c63f837-4c94-4b87-81aa-46c6afd37fad tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.159114 Apr 26 14:13:36.296795 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 211/417] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:36 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:36.306015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:36.306630 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:36.312319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:36.312772 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:36.313538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:36.313996 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:36.383297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:36.391655 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-24035827-c718-4449-935d-ac6a4e6daa8e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1270 microversion: 2.1 time: 0.089472 Apr 26 14:13:36.392223 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 212/418] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:36 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:36.403507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1071647473", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db62da73-59c6-4f6f-98fa-3d9fee96e03d"}], "security_groups": [{"name": "tempest-securitygroup--671729537"}], "key_name": "tempest-keypair-1870176890", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:36.513105 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] validate_networks() for [('db62da73-59c6-4f6f-98fa-3d9fee96e03d', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:13:36.612128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ca7ebfcc-010a-4004-94b7-d3883cecff0b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.890645 Apr 26 14:13:36.614188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 207/419] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:13:35 2022] POST /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments => generated 194 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:36.618300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:36.620325 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:36.631333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:36.631770 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:36.632555 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:36.632987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:36.794055 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:36.803064 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f7c712e7-832e-47de-9da1-d01a33564d19 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.188401 Apr 26 14:13:36.803454 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 208/420] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:36 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:37.101600 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:13:37.102056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:13:37.102854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:13:37.103336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:13:37.103741 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:13:37.112210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.112653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.114057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.114488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.130622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:13:37.134575 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:13:37.145905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:13:37.148241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:13:37.266464 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1de5c068-9fc5-4108-b13f-0775068fd976 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.867060 Apr 26 14:13:37.267106 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 213/421] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:13:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:13:37.277621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a216d184-ebb9-43d5-8766-63bcfb94f1e2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:37.278265 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a216d184-ebb9-43d5-8766-63bcfb94f1e2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:37.312916 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:37.313626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:37.319864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.322525 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.322525 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.322525 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.329606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a216d184-ebb9-43d5-8766-63bcfb94f1e2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:37.337030 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a216d184-ebb9-43d5-8766-63bcfb94f1e2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1242 microversion: 2.1 time: 0.063333 Apr 26 14:13:37.337763 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 209/422] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:37 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:37.408949 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:37.409562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:37.418614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.419071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.419851 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.420544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.510473 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:37.518385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7e9831d3-4fbc-4cc5-a0a3-9330538f5d64 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.209434 Apr 26 14:13:37.518954 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 214/423] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:37 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:37.602045 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:37.609292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a071618b-ae2d-4820-bd87-3dabbeb7ed93 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.204559 Apr 26 14:13:37.609867 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 210/424] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:37 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:37.822263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:37.822997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:37.829152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.829792 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.831083 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:37.832414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:37.978032 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:37.986019 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3d46d88e-d87a-4993-be97-c3a94905b5e1 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.167541 Apr 26 14:13:37.986581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 215/425] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:37 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:38.344245 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-2d2b7883-71b5-4476-92c5-c2b5caf5bbfb req-99ff9631-d2bf-42dd-b114-0ed42b23c32e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94816324-7a54-45ee-b136-d51dbf835036", "tag": "810ab89f-1bef-4d1f-8904-66a25c3ff2cf"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:38.354424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:38.354817 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-2d2b7883-71b5-4476-92c5-c2b5caf5bbfb req-99ff9631-d2bf-42dd-b114-0ed42b23c32e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.355186 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:38.355309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-2d2b7883-71b5-4476-92c5-c2b5caf5bbfb req-99ff9631-d2bf-42dd-b114-0ed42b23c32e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.361451 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.361905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.363013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.364136 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.370356 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-2d2b7883-71b5-4476-92c5-c2b5caf5bbfb req-99ff9631-d2bf-42dd-b114-0ed42b23c32e service nova] Creating event network-changed:810ab89f-1bef-4d1f-8904-66a25c3ff2cf for instance 94816324-7a54-45ee-b136-d51dbf835036 on hv-cinder-83513 Apr 26 14:13:38.375478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-2d2b7883-71b5-4476-92c5-c2b5caf5bbfb req-99ff9631-d2bf-42dd-b114-0ed42b23c32e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035619 Apr 26 14:13:38.376868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 211/426] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:38.425335 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:38.433257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ef917318-ea1a-41d1-b535-b3f8d63f5b6a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1246 microversion: 2.1 time: 0.082632 Apr 26 14:13:38.435641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 216/427] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:38 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:38.537611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:38.538931 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:38.545549 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.548019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.548019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.548019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.626664 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:38.627287 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:38.633873 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.634400 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.635175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:38.635603 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:38.792213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:38.800618 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e9a8272b-e088-4f03-8a99-db47c9c7a92c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.177835 Apr 26 14:13:38.801193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 217/428] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:38 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:38.949244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:38.956618 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f14f8ef5-9b7b-460f-9cc9-0393d21b2c6c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.424108 Apr 26 14:13:38.957705 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 212/429] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:38 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:39.008904 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:39.009863 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:39.015815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.016343 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.017189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.017723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.161901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:39.172067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d92f3535-22d4-415c-99b5-c52bb586d56a tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.166585 Apr 26 14:13:39.173168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 218/430] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:39 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:39.454435 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:39.455125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:39.461544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.462026 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.462813 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.463257 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.542077 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:39.550954 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-130f6c50-af2d-4f6f-8f92-f3a3f6c1eae3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1302 microversion: 2.1 time: 0.103876 Apr 26 14:13:39.551767 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 213/431] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:39 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:39.819490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:39.820723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:39.829814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.830278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.831060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.832226 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.976710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:39.976710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:39.979997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:39.981484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.981939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.982962 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:39.983909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:39.987531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4477f9d6-da4d-4db8-8d1b-9c0dd1f7031c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.173640 Apr 26 14:13:39.988687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 219/432] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:39 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:40.158856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:40.167571 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9b0b3bf1-b629-41a9-a1f3-453572bcd1fa tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.197347 Apr 26 14:13:40.168148 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 214/433] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:39 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:40.188473 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:40.189079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:40.195738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:40.195976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:40.196753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:40.197625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:40.365058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:40.373898 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6d0de74b-f7c4-4436-a0e6-e8fbbfcf0d20 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.189172 Apr 26 14:13:40.378013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 220/434] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:40 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:40.568987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:40.569663 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:40.576288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:40.576750 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:40.577494 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:40.577926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:40.794464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:40.801607 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0da1fd70-d4f1-4e4a-a69a-0d90666a37df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.237127 Apr 26 14:13:40.802222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 215/435] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:40 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:41.005534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:41.006422 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:41.012792 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.013538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.014337 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.014936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.161885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:41.169322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-38296a5e-9e49-4686-bd6b-dccd5ea68532 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.168516 Apr 26 14:13:41.169883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 221/436] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:40 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:41.184679 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:41.185307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:41.191959 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.192412 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.193191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.193632 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.237600 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-cad56ac9-05d4-4da1-9dab-cb080fc445c5 req-21157196-3035-498a-ae54-ab41a249c536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcfc893-f654-43b1-9ff6-fdd104caa297", "tag": "b92a86e1-039b-46bc-968d-6f19f3817a02"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:41.246591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-cad56ac9-05d4-4da1-9dab-cb080fc445c5 req-21157196-3035-498a-ae54-ab41a249c536 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.247063 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-cad56ac9-05d4-4da1-9dab-cb080fc445c5 req-21157196-3035-498a-ae54-ab41a249c536 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.259643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-cad56ac9-05d4-4da1-9dab-cb080fc445c5 req-21157196-3035-498a-ae54-ab41a249c536 service nova] Creating event network-changed:b92a86e1-039b-46bc-968d-6f19f3817a02 for instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 on hv-cinder-83513 Apr 26 14:13:41.268061 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-cad56ac9-05d4-4da1-9dab-cb080fc445c5 req-21157196-3035-498a-ae54-ab41a249c536 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034229 Apr 26 14:13:41.269038 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 222/437] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:41.392241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:41.392962 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:41.400484 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.401178 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.402062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.402718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.474226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:41.485470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-86cb8873-0b7f-4321-aa1b-2f2df3867acc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.304402 Apr 26 14:13:41.497690 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 216/438] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:41 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:41.566997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:41.572168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-86dd37d3-af2e-49c2-82ef-0bbbff4e4568 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.184619 Apr 26 14:13:41.577259 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 223/439] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:41 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:41.819063 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:41.819821 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:41.826395 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.826850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:41.827621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:41.828059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.071114 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:42.078440 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f2788908-08e5-4dcb-b468-2b3c327c7502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.263021 Apr 26 14:13:42.078994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 217/440] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:41 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:42.186452 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:42.187054 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:42.193768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:42.194233 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.194991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:42.195420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.323093 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:42.330118 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4ad82170-cf4b-4b5a-a509-557333120819 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.147402 Apr 26 14:13:42.330673 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 224/441] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:42 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:42.503252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:42.504470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:42.510208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:42.510661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.511425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:42.511862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.590266 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:42.590946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:42.611136 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:42.611591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.612376 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:42.612824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:42.651614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:42.659014 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d666e2f1-c6f6-47b6-a18c-6a69c528d7ed tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.159555 Apr 26 14:13:42.659593 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 218/442] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:42 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:42.760778 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:42.768422 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c77683eb-80f8-4cca-8dfb-d5d08249a502 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.182350 Apr 26 14:13:42.768991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 225/443] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:42 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:43.095036 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:43.095653 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:43.102551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.103004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.103782 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.104224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.236114 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:43.243403 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-282a94f7-038a-407a-bad6-9ad1bf05a3c2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.152167 Apr 26 14:13:43.244050 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 219/444] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:43 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:43.348061 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:43.348675 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:43.354930 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.355378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.356133 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.356563 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.485406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:43.492625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-79bc979e-7082-417b-ae46-f316e715afba tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.148983 Apr 26 14:13:43.493183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 226/445] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:43 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:43.676047 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:43.676664 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:43.682510 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.682968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.683741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.684182 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.784400 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:43.785203 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:43.791223 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.791739 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.792585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:43.793021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:43.810947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:43.818836 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d7d62dfc-d177-4bf9-bd31-a75ab8c47542 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.146622 Apr 26 14:13:43.819411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 220/446] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:43 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:43.935945 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:43.944460 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c54f5b0c-64ea-41c3-85a9-aa49a5784aa0 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.163859 Apr 26 14:13:43.945027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 227/447] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:43 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:44.260641 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:44.261252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:44.267672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.268065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.268829 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.269263 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.396762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:44.403905 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-dc079834-a95a-4f42-badf-b1a78498074a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.147053 Apr 26 14:13:44.404465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 221/448] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:44 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:44.509067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:44.509680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:44.516126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.516574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.517344 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.517830 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.649726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:44.657048 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-334604c6-66d9-4b47-a243-11a744a6e119 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.151780 Apr 26 14:13:44.657613 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 228/449] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:44 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:44.839910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:44.840523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:44.846378 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.846825 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.847583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.848017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.964261 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:44.964907 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:44.970868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.971319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.972094 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:44.972530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:44.981628 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:44.989180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f9740e00-c79b-4732-b4e0-cca7bfc9a3a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.153038 Apr 26 14:13:44.990094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 222/450] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:44 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:45.122045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:45.130326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c2258a3f-e8fe-4e5c-ba87-cd7ec665cc1b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1756 microversion: 2.1 time: 0.169591 Apr 26 14:13:45.130919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 229/451] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:44 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:45.420961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:45.421502 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:45.428396 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:45.428870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:45.429615 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:45.430078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:45.558183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:45.569429 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-35883306-d8b1-4990-8a16-1714633670ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.152210 Apr 26 14:13:45.570282 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 223/452] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:45 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:45.674768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:45.675281 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:45.682028 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:45.682585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:45.683215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:45.683644 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:45.819518 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:45.826731 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-900a00d0-fb48-44fc-b6a2-aedc579d5a1a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.155886 Apr 26 14:13:45.827296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 230/453] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:45 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:46.005757 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:46.006402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:46.012115 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.012566 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.013334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.013771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.147360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:46.153648 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:46.154287 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:46.159191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-58701f47-d2d3-40b8-8f28-0c84f19d03e0 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1678 microversion: 2.1 time: 0.157306 Apr 26 14:13:46.159762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 224/454] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:46 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:46.160214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.160667 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.162090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.162535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.303302 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:46.310964 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4d5ae196-2bac-446a-a57e-f750dff8b7b8 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1759 microversion: 2.1 time: 0.167622 Apr 26 14:13:46.311524 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 231/455] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:46 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1759 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:46.591095 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:46.591708 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:46.598149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.598665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.599440 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.599881 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.730556 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:46.739637 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-028b3b0f-c966-4a31-ae38-c6b8cc539aec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.152397 Apr 26 14:13:46.740307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 225/456] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:46 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:46.756883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-628b3bcf-1927-45f5-a1ce-fc2d0486d470 req-8f287962-e983-4979-a1dc-98b406ab54aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94816324-7a54-45ee-b136-d51dbf835036", "name": "network-vif-plugged", "status": "completed", "tag": "810ab89f-1bef-4d1f-8904-66a25c3ff2cf"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:46.765064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-628b3bcf-1927-45f5-a1ce-fc2d0486d470 req-8f287962-e983-4979-a1dc-98b406ab54aa service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.765508 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-628b3bcf-1927-45f5-a1ce-fc2d0486d470 req-8f287962-e983-4979-a1dc-98b406ab54aa service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.776661 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-628b3bcf-1927-45f5-a1ce-fc2d0486d470 req-8f287962-e983-4979-a1dc-98b406ab54aa service nova] Creating event network-vif-plugged:810ab89f-1bef-4d1f-8904-66a25c3ff2cf for instance 94816324-7a54-45ee-b136-d51dbf835036 on hv-cinder-83513 Apr 26 14:13:46.781537 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-628b3bcf-1927-45f5-a1ce-fc2d0486d470 req-8f287962-e983-4979-a1dc-98b406ab54aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029254 Apr 26 14:13:46.783394 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 232/457] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:46.843681 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:46.844304 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:46.850496 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.850942 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.851716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:46.852159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:46.981044 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:46.989828 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-15cd33a4-963d-490b-b447-156c6be928f9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.149630 Apr 26 14:13:46.990427 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 226/458] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:46 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:47.177528 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:47.178488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:47.184569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.185092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.185864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.186326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.330283 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:47.337521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-29e87dd8-336d-4648-8d4d-04d3f3e9b8eb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1655 microversion: 2.1 time: 0.164711 Apr 26 14:13:47.338116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 233/459] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:47 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1655 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:47.357857 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-31dba037-8eab-4caf-a0a1-a53a1196de39 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:47.363665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31dba037-8eab-4caf-a0a1-a53a1196de39 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.364784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31dba037-8eab-4caf-a0a1-a53a1196de39 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.421660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-31dba037-8eab-4caf-a0a1-a53a1196de39 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Going to try to start instance {{(pid=117600) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 26 14:13:47.651099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-31dba037-8eab-4caf-a0a1-a53a1196de39 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action" status: 202 len: 0 microversion: 2.1 time: 0.296798 Apr 26 14:13:47.651766 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 227/460] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:13:47 2022] POST /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:13:47.660046 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:47.660713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:47.667421 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.667921 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.668687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.669123 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.756258 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:47.757000 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:47.764828 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.765273 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.766219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:47.773294 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:47.799901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:47.807651 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-092b90b5-2564-45b4-b0a8-8c64c900dfe9 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1664 microversion: 2.1 time: 0.151410 Apr 26 14:13:47.809059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 234/461] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:47 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1664 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:47.986703 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:47.993737 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f66e9deb-8736-4dd3-bbbe-b96d834d5a0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.241557 Apr 26 14:13:47.994341 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 228/462] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:47 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:48.007432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:48.008099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:48.014347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:48.014785 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:48.015541 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:48.015966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:48.146900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:48.153986 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ff06a87d-6abd-47ac-9775-33e715163d64 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1318 microversion: 2.1 time: 0.150907 Apr 26 14:13:48.154564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 235/463] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:48 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:48.824779 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:48.825383 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:48.832231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:48.836883 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:48.838286 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:48.845150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:48.985238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:48.993318 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5ae15bb6-d115-4de3-8657-7b5044ef868f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1664 microversion: 2.1 time: 0.172331 Apr 26 14:13:48.993892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 229/464] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:48 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1664 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:49.009725 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:49.010364 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:49.016608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:49.017060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:49.017833 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:49.018298 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:49.154498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:49.162352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-17aee49a-114d-405e-93ef-6056a284169a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.156339 Apr 26 14:13:49.171035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:49.171646 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:49.172023 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 236/465] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:49 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:49.178203 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:49.178909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:49.179749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:49.180255 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:49.319954 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:49.327155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8bae3210-1fdf-434a-8f93-ec78d55eae0a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1508 microversion: 2.1 time: 0.160060 Apr 26 14:13:49.327709 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 230/466] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:49 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:13:50.011727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:50.012337 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:50.018514 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:50.018961 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:50.019722 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:50.020155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:50.151057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:50.158852 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ab91485b-73e4-415b-b705-2395745be32d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1668 microversion: 2.1 time: 0.150959 Apr 26 14:13:50.159555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 237/467] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:50 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:50.186224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:50.186224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:50.186794 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:50.187312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:50.188146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:50.188658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:50.326971 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:50.334251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5a7eb0c1-e9ce-4419-92a2-9f6dd5a3ab18 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.159200 Apr 26 14:13:50.334807 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 231/468] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:50 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:50.935805 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-edd8ccc1-db85-47b0-819e-67d3f0cd8702 req-c6cc974f-d8ff-43e1-be22-1a032680ff1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcfc893-f654-43b1-9ff6-fdd104caa297", "name": "network-vif-plugged", "status": "completed", "tag": "b92a86e1-039b-46bc-968d-6f19f3817a02"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:50.943925 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-edd8ccc1-db85-47b0-819e-67d3f0cd8702 req-c6cc974f-d8ff-43e1-be22-1a032680ff1a service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:50.944372 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-edd8ccc1-db85-47b0-819e-67d3f0cd8702 req-c6cc974f-d8ff-43e1-be22-1a032680ff1a service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:50.955410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-edd8ccc1-db85-47b0-819e-67d3f0cd8702 req-c6cc974f-d8ff-43e1-be22-1a032680ff1a service nova] Creating event network-vif-plugged:b92a86e1-039b-46bc-968d-6f19f3817a02 for instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 on hv-cinder-83513 Apr 26 14:13:50.961055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-edd8ccc1-db85-47b0-819e-67d3f0cd8702 req-c6cc974f-d8ff-43e1-be22-1a032680ff1a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034877 Apr 26 14:13:50.961682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 238/469] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:51.351191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:51.351787 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:51.358603 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:51.359288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:51.360231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:51.360860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:51.639360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:51.647804 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2169cce8-5f2f-4b55-8183-80aa3fdff812 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.300419 Apr 26 14:13:51.648387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 232/470] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:51 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:52.666620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:52.667326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:52.673194 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:52.673635 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:52.674414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:52.674840 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:52.815747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:52.824239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a0587af4-dbcf-4b88-8c43-b320dc522391 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1367 microversion: 2.1 time: 0.163430 Apr 26 14:13:52.829284 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 239/471] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:52 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:53.840931 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:53.841532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:53.848874 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:53.851985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:53.851985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:53.851985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:54.003116 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:13:54.010761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8713e00c-2577-4e49-a4b9-0ab01b8008f5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1558 microversion: 2.1 time: 0.173999 Apr 26 14:13:54.011321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 233/472] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:13:53 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:13:54.029106 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:13:54.029636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:13:54.035677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:54.036170 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:54.036953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:54.037388 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:54.119879 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b9a47f0d-2a4e-483f-89b8-8bb833b9d3a2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095617 Apr 26 14:13:54.120475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 240/473] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:13:54 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:13:55.156261 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-56ab09ea-4af9-4182-876a-762885172feb req-5a62fd1c-7508-4027-a3ee-99ced7231e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcfc893-f654-43b1-9ff6-fdd104caa297", "tag": "b92a86e1-039b-46bc-968d-6f19f3817a02"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:13:55.165387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-56ab09ea-4af9-4182-876a-762885172feb req-5a62fd1c-7508-4027-a3ee-99ced7231e53 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:13:55.165833 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-56ab09ea-4af9-4182-876a-762885172feb req-5a62fd1c-7508-4027-a3ee-99ced7231e53 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:13:55.177119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-56ab09ea-4af9-4182-876a-762885172feb req-5a62fd1c-7508-4027-a3ee-99ced7231e53 service nova] Creating event network-changed:b92a86e1-039b-46bc-968d-6f19f3817a02 for instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 on hv-cinder-83513 Apr 26 14:13:55.181886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-56ab09ea-4af9-4182-876a-762885172feb req-5a62fd1c-7508-4027-a3ee-99ced7231e53 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029239 Apr 26 14:13:55.182497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 234/474] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:02.031903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:02.032878 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:02.039588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:02.040035 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:02.040793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:02.041227 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:02.062768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'flavor' on Instance uuid 1af8e557-0521-4ed6-971f-dfa80ec191c9 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:02.388164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2595043c-d6e6-468a-a0e5-2b7f6972b2e6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/action" status: 200 len: 32 microversion: 2.1 time: 0.360603 Apr 26 14:14:02.388800 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 241/475] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:14:02 2022] POST /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/action => generated 32 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:14:02.400432 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:02.401218 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:02.407203 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:02.407823 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:02.408654 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:02.409153 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:02.620162 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:02.627751 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bd300131-f1ee-4867-b8ac-87051fc94701 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.232600 Apr 26 14:14:02.628318 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 235/476] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:02 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:03.646495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:03.647719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:03.653817 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:03.654472 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:03.655132 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:03.655565 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:03.789913 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:03.797561 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-def6f8e0-7fad-4256-9ad7-e04ae574b778 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.155774 Apr 26 14:14:03.798142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 242/477] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:03 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:04.814674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:04.815292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:04.821797 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:04.829206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:04.829206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:04.829206 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:04.952597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:04.960830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-26a6387c-05c2-4331-898d-3678f101f283 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.149974 Apr 26 14:14:04.961388 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 236/478] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:04 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:05.851911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2995df7a-ebdb-4049-9944-95c4c96bcd30", "device": "/dev/sdb"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:05.853679 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:05.860336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:05.860775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:05.861557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:05.862007 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:05.978408 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:05.984689 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:05.985330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:05.985783 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:05.986585 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:05.987021 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:06.122953 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:06.130690 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8294cec6-7749-4a4c-b7a7-45b9a3120d85 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.156609 Apr 26 14:14:06.131401 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 237/479] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:05 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:06.422011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8c385752-8f08-4081-b401-48dcf3b10531 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "POST /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.573777 Apr 26 14:14:06.422543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 243/480] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:14:05 2022] POST /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036/os-volume_attachments => generated 194 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:07.149981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:07.150599 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:07.156741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:07.157191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:07.157956 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:07.158410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:07.286610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:07.295240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6074d67a-5e06-43ab-9dc1-36d4187992df tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.151048 Apr 26 14:14:07.295806 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 238/481] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:07 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:08.313366 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:08.314157 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:08.320229 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:08.320676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:08.321436 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:08.321866 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:08.449880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:08.457682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2f53ab50-d7ba-45a9-b399-746e6d267742 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.148928 Apr 26 14:14:08.458269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 244/482] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:08 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:09.474802 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:09.475415 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:09.481633 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:09.482110 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:09.482880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:09.483312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:09.614183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:09.622430 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c7d45707-1e62-4956-b5c7-6e34b7fef5d0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.151384 Apr 26 14:14:09.623007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 239/483] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:09 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:10.640342 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:10.640946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:10.647423 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:10.648403 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:10.649164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:10.649595 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:10.784880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:10.793436 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0a49e861-836a-42e6-9407-572f25038827 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.157011 Apr 26 14:14:10.794012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 245/484] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:10 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:11.810875 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:11.811477 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:11.817706 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:11.818198 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:11.818965 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:11.819937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:12.022430 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:12.030130 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3e197680-a6ff-4def-9b42-a1046ad2ccb4 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.223029 Apr 26 14:14:12.030693 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 240/485] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:11 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:13.047462 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:13.048036 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:13.054255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:13.054698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:13.055449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:13.055874 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:13.182198 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:13.189917 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-968b1b5c-5ea5-43c7-b713-5575ecc855cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.146334 Apr 26 14:14:13.190527 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 246/486] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:13 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:14.207475 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:14.208083 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:14.214961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:14.215431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:14.216821 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:14.217273 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:14.349009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:14.357432 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6980086d-c7ba-4563-9383-8436126c1dde tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.153889 Apr 26 14:14:14.358020 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 241/487] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:14 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:15.375141 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:15.375742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:15.381993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:15.382442 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:15.383209 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:15.383638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:15.513844 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:15.521578 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0170b293-dc38-4aaf-b3b1-0ae3cb3c12cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.150284 Apr 26 14:14:15.522172 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 247/488] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:15 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:16.539061 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:16.539672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:16.546527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:16.546987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:16.547751 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:16.548271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:16.680261 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:16.688633 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-007a1acf-11ab-40eb-be94-68c980ac6d6f tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.153631 Apr 26 14:14:16.689200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 242/489] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:16 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:17.709231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:17.709231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:17.713135 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:17.713580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:17.714399 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:17.714838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:17.847410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:17.855151 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ccd9f94c-d67f-43e5-b946-345fd158a669 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.152817 Apr 26 14:14:17.855718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 248/490] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:17 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:18.872108 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:18.872723 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:18.879722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:18.881146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:18.881146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:18.881364 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:19.016625 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:19.024307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-296df792-1503-47cf-8417-b3cc8a425752 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.156544 Apr 26 14:14:19.024897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 243/491] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:18 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:20.041586 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:20.042213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:20.048478 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:20.048923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:20.049680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:20.050143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:20.177676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:20.185947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-338adf2f-5045-4b3e-b826-ac4ccc1b101d tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.148328 Apr 26 14:14:20.186535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 249/492] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:20 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:21.203447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:21.203974 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:21.210183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:21.210631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:21.211386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:21.211822 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:21.343333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:21.351156 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-dceebc43-c115-4da3-a947-3570fe2b2b20 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.152048 Apr 26 14:14:21.352029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 244/493] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:21 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:22.368513 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:22.369118 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:22.375372 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:22.375843 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:22.376598 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:22.377024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:22.510047 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:22.518218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fd8e5ef9-1923-4817-a878-b9be1155f773 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.153581 Apr 26 14:14:22.518803 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 250/494] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:22 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:23.536114 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:23.536653 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:23.544014 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:23.544466 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:23.545237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:23.545700 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:23.673861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:23.681512 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bc8066f8-2934-4a25-a31e-06fce8e58aae tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.149301 Apr 26 14:14:23.682099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 245/495] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:23 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:24.698368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:24.699008 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:24.705175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:24.705642 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:24.706420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:24.706845 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:24.833447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:24.841290 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-43b840f6-2688-4bb0-ae9e-59ea1ea5a232 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.146678 Apr 26 14:14:24.841854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 251/496] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:24 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:25.858320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:25.858936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:25.865163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:25.872180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:25.872180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:25.872180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:25.995738 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:26.003838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-278c4384-9453-405d-b5e3-3bbbd1bcc2a2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.149388 Apr 26 14:14:26.004406 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 246/497] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:25 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:27.021752 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:27.022304 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:27.029119 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:27.029585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:27.030392 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:27.030829 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:27.159658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:27.167598 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-cba0d37c-e997-427c-a94f-d16f784dd2f3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.149776 Apr 26 14:14:27.168159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 252/498] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:27 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:28.184661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:28.185270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:28.191507 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:28.191951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:28.192720 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:28.193155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:28.324743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:28.332897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-54d42eea-8092-4a74-8af6-d6135e8b2061 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.152090 Apr 26 14:14:28.333463 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 247/499] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:28 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:29.350215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:29.350809 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:29.357516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:29.358020 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:29.358779 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:29.359207 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:29.493530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:29.501471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c60efee7-6d29-460d-893a-9a8f74670d24 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.155332 Apr 26 14:14:29.502068 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 253/500] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:29 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:30.519448 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:30.520059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:30.526348 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:30.526830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:30.527604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:30.528062 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:30.656041 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:30.664117 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-007ab8d6-e623-49e4-a4d5-1118d395ad38 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.148545 Apr 26 14:14:30.664803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 248/501] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:30 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:31.014499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:31.014981 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:31.021388 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:31.021842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:31.022643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:31.023077 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:31.141693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lazy-loading 'services' on Instance uuid 94816324-7a54-45ee-b136-d51dbf835036 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:31.338429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-86cd6e25-00e7-404d-8b07-695bdc52293b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "DELETE /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036/os-volume_attachments/2995df7a-ebdb-4049-9944-95c4c96bcd30" status: 202 len: 0 microversion: 2.1 time: 0.327614 Apr 26 14:14:31.339294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 254/502] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:14:31 2022] DELETE /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036/os-volume_attachments/2995df7a-ebdb-4049-9944-95c4c96bcd30 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:31.681716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:31.682353 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:31.689452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:31.689896 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:31.690682 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:31.691114 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:32.045521 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:32.053133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bf0164e1-04d2-4020-b955-bad458e924b0 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.375242 Apr 26 14:14:32.053692 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 249/503] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:31 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:32.455156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:32.455737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:32.461939 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:32.462419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:32.463192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:32.463626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:32.487347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:14:32.823638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9b9cdda4-99b1-4acc-b267-246953d374a1 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "DELETE /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 204 len: 0 microversion: 2.1 time: 0.374136 Apr 26 14:14:32.824235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 255/504] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:14:32 2022] DELETE /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:14:32.832215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:32.832835 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:32.840394 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:32.840954 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:32.841740 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:32.842339 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:32.973172 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:32.980336 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ba12b06c-c7b5-4c35-a89c-dd8b429795ad tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1514 microversion: 2.1 time: 0.151901 Apr 26 14:14:32.980892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 250/505] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:32 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:33.070512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:33.071201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:33.077467 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:33.077846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:33.078630 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:33.079060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:33.207726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:33.215531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e7851cdb-c546-402a-b826-75df43b166a8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.149126 Apr 26 14:14:33.216099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 256/506] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:33 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:33.996744 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:33.997344 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:34.003763 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:34.004210 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:34.004969 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:34.005400 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:34.133173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:34.140939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-def1d9dc-0530-41b0-81ca-60e4c3e20e6b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1514 microversion: 2.1 time: 0.147684 Apr 26 14:14:34.141495 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 251/507] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:33 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:34.232356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:34.232960 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:34.239771 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:34.240216 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:34.240978 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:34.241409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:34.372566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:34.380741 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7cd69594-f879-4d93-b5fc-00b3b7ac4083 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.152168 Apr 26 14:14:34.381303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 257/508] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:34 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:35.158259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:35.158874 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:35.165370 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:35.165761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:35.166558 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:35.166996 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:35.344447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:35.351699 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f0f2f6f8-0d28-495c-b766-ed37f10720fc tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1514 microversion: 2.1 time: 0.197986 Apr 26 14:14:35.352267 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 252/509] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:35 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:35.396931 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:35.397520 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:35.403722 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:35.404164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:35.405124 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:35.405605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:35.544223 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:35.552638 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c438fa83-3419-4da8-8140-1ff97e25a587 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1734 microversion: 2.1 time: 0.159504 Apr 26 14:14:35.553207 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 258/510] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:35 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:35.774147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-ff133090-10c5-42aa-ad25-6ddd69e40f86 req-6a4c600a-b698-4c3b-b24c-88328a17af7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94816324-7a54-45ee-b136-d51dbf835036", "name": "network-vif-deleted", "tag": "810ab89f-1bef-4d1f-8904-66a25c3ff2cf"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:35.782320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-ff133090-10c5-42aa-ad25-6ddd69e40f86 req-6a4c600a-b698-4c3b-b24c-88328a17af7f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:35.782762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-ff133090-10c5-42aa-ad25-6ddd69e40f86 req-6a4c600a-b698-4c3b-b24c-88328a17af7f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:35.793474 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-ff133090-10c5-42aa-ad25-6ddd69e40f86 req-6a4c600a-b698-4c3b-b24c-88328a17af7f service nova] Creating event network-vif-deleted:810ab89f-1bef-4d1f-8904-66a25c3ff2cf for instance 94816324-7a54-45ee-b136-d51dbf835036 on hv-cinder-83513 Apr 26 14:14:35.798645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-ff133090-10c5-42aa-ad25-6ddd69e40f86 req-6a4c600a-b698-4c3b-b24c-88328a17af7f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028196 Apr 26 14:14:35.799291 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 253/511] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:36.368411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:36.369007 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:36.375303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.375912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.376665 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.377092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.406854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.407493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.407724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lazy-loading 'fault' on Instance uuid 94816324-7a54-45ee-b136-d51dbf835036 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:36.446824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:36.454651 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6c369c14-219d-4638-8ca9-48095928a75b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 200 len: 1308 microversion: 2.1 time: 0.090137 Apr 26 14:14:36.455220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 259/512] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:36 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 1308 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:36.571623 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:36.572314 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:36.578586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.579075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.579839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.580269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.719892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:36.730083 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0e60ec31-bdc3-4659-8fc1-c38024a9c9fe tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1714 microversion: 2.1 time: 0.162376 Apr 26 14:14:36.730083 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 254/513] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:36 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:36.828075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:36.828573 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:36.834479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.834933 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.835694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.836296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.915195 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] HTTP exception thrown: Cannot 'detach_volume' instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 while it is in vm_state rescued Apr 26 14:14:36.915870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Returning 409 to user: Cannot 'detach_volume' instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 while it is in vm_state rescued {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:36.916974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-081e0055-27b6-4272-a212-71843f2324e2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments/bba9c4dc-db04-48b1-983b-4f3226749dff" status: 409 len: 152 microversion: 2.1 time: 0.092912 Apr 26 14:14:36.917515 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 260/514] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:14:36 2022] DELETE /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments/bba9c4dc-db04-48b1-983b-4f3226749dff => generated 152 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 26 14:14:36.926465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:36.927001 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:36.932854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.933304 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:36.934103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:36.934540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:37.100912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6630dd20-64e4-40c0-8195-ddbe65022f13 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "POST /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/action" status: 202 len: 0 microversion: 2.1 time: 0.178124 Apr 26 14:14:37.101628 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 255/515] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:14:36 2022] POST /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/action => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:37.110696 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:37.111355 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:37.118695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:37.119147 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:37.119919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:37.120357 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:37.253723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:37.261652 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-96f063ab-a2dd-474e-91eb-e4b1f459913a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1722 microversion: 2.1 time: 0.155659 Apr 26 14:14:37.262241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 261/516] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:37 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:37.472969 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:37.473591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: 94816324-7a54-45ee-b136-d51dbf835036] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:37.479506 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:37.479956 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:37.480756 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:37.481189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:37.494262 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] HTTP exception thrown: Instance 94816324-7a54-45ee-b136-d51dbf835036 could not be found. Apr 26 14:14:37.494851 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Returning 404 to user: Instance 94816324-7a54-45ee-b136-d51dbf835036 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:37.495686 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-60778e4c-816c-4cdd-b6c0-dd39ac78ce6d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036" status: 404 len: 111 microversion: 2.1 time: 0.027580 Apr 26 14:14:37.496216 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 256/517] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:37 2022] GET /compute/v2.1/servers/94816324-7a54-45ee-b136-d51dbf835036 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:14:38.279662 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:38.280200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:38.286312 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:38.286752 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:38.287498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:38.287923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:38.427676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:38.435804 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2f575da7-c699-48c0-a7c0-8d22d467d2ef tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1722 microversion: 2.1 time: 0.160039 Apr 26 14:14:38.436361 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 262/518] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:38 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:39.455249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:39.455865 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:39.462077 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:39.462528 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:39.463318 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:39.463759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:39.596694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:39.604353 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c92ccab0-b93b-4ba6-990e-9cac519859bf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1722 microversion: 2.1 time: 0.153692 Apr 26 14:14:39.604910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 257/519] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:39 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:40.622143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:40.622749 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:40.629479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:40.629919 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:40.630697 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:40.631303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:40.763969 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:40.772307 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ce3d6644-4097-4831-b8a1-d1b00c0b3db5 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1722 microversion: 2.1 time: 0.154032 Apr 26 14:14:40.772863 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 263/520] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:40 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:41.763747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:41.764713 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:41.770967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:41.771428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:41.772200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:41.772641 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:41.788848 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:41.789482 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:41.795615 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:41.796596 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:41.797375 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:41.797792 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:41.801831 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f18d3308-cf29-4261-8015-5387edcae85b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041932 Apr 26 14:14:41.802420 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 258/521] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:41 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:14:41.862151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:41.862659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:41.868746 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:41.870801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:41.870801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:41.870801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:41.894477 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:14:41.930056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:41.937847 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-053c71f3-1549-4274-a04c-f580426da24b tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1722 microversion: 2.1 time: 0.153089 Apr 26 14:14:41.939591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 264/522] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:41 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:42.166797 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-31644ab1-7e50-4f81-b831-e729fd631f07 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 204 len: 0 microversion: 2.1 time: 0.308306 Apr 26 14:14:42.167653 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 259/523] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:14:41 2022] DELETE /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 26 14:14:42.175643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:42.176591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:42.182432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:42.182883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:42.183651 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:42.184084 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:42.327047 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:42.334905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5f75c3a9-b00b-42aa-919d-1aedabcf686c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1674 microversion: 2.1 time: 0.163137 Apr 26 14:14:42.335507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 265/524] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:42 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:42.954937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:42.955557 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:42.961797 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:42.962278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:42.963041 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:42.963478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:43.091231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:43.099391 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f5833710-3651-4aba-9efe-fe5d0d60c113 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1728 microversion: 2.1 time: 0.148712 Apr 26 14:14:43.099947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 260/525] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:42 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:43.116166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:43.116639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:43.123033 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:43.123486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:43.124259 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:43.124695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:43.206546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d42f6773-19ca-4b05-8f82-de5c5a491228 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094032 Apr 26 14:14:43.207113 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 266/526] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:14:43 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:43.352523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:43.353132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:43.358889 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:43.359457 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:43.360097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:43.360527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:43.617568 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:43.624844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0d98203c-0cb9-4a75-ae24-698481af8cb6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1674 microversion: 2.1 time: 0.276128 Apr 26 14:14:43.625413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 261/527] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:43 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1674 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:44.225344 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-42a35d22-9e73-48ef-8bef-de26906492fb req-a328768b-f4e1-4f59-ae70-211c63f58c0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8e557-0521-4ed6-971f-dfa80ec191c9", "tag": "e48d3e25-6975-41a5-953a-e283cc06a7c3"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:44.233868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-42a35d22-9e73-48ef-8bef-de26906492fb req-a328768b-f4e1-4f59-ae70-211c63f58c0e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:44.235537 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-42a35d22-9e73-48ef-8bef-de26906492fb req-a328768b-f4e1-4f59-ae70-211c63f58c0e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:44.247109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-42a35d22-9e73-48ef-8bef-de26906492fb req-a328768b-f4e1-4f59-ae70-211c63f58c0e service nova] Creating event network-changed:e48d3e25-6975-41a5-953a-e283cc06a7c3 for instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 on hv-cinder-83513 Apr 26 14:14:44.258583 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-42a35d22-9e73-48ef-8bef-de26906492fb req-a328768b-f4e1-4f59-ae70-211c63f58c0e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031977 Apr 26 14:14:44.258583 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 267/528] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:14:44.643294 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:44.643909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:44.650361 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:44.651587 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:44.651587 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:44.652032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:44.788934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:44.796159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-77f3aebb-643b-4231-b81d-fd83a2663d12 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1674 microversion: 2.1 time: 0.156814 Apr 26 14:14:44.796722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 262/529] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:44 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:45.813475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:45.814182 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:45.820553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:45.820995 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:45.821746 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:45.822208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:45.951072 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:45.958885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-010f6c6d-e518-4d27-acad-7c6799425c9d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1674 microversion: 2.1 time: 0.149576 Apr 26 14:14:45.959448 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 268/530] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:45 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:46.267059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-0340645c-b808-4eda-9f22-1a9cb5628852 req-f0b9b64b-8b61-402e-8371-5fbe6604639b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af8e557-0521-4ed6-971f-dfa80ec191c9", "tag": "e48d3e25-6975-41a5-953a-e283cc06a7c3"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:46.275290 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0340645c-b808-4eda-9f22-1a9cb5628852 req-f0b9b64b-8b61-402e-8371-5fbe6604639b service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:46.275728 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0340645c-b808-4eda-9f22-1a9cb5628852 req-f0b9b64b-8b61-402e-8371-5fbe6604639b service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:46.285898 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-0340645c-b808-4eda-9f22-1a9cb5628852 req-f0b9b64b-8b61-402e-8371-5fbe6604639b service nova] Creating event network-changed:e48d3e25-6975-41a5-953a-e283cc06a7c3 for instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 on hv-cinder-83513 Apr 26 14:14:46.290908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-0340645c-b808-4eda-9f22-1a9cb5628852 req-f0b9b64b-8b61-402e-8371-5fbe6604639b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027479 Apr 26 14:14:46.291461 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 263/531] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:46.872089 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-11990393"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:46.873424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:46.879735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:46.880188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:46.880968 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:46.881406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:46.977098 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:46.977791 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:46.983784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:46.984230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:46.984990 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:46.985605 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:47.018149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.network.security_group_api [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Removing security group ad8b00a7-ca9f-4274-b3b7-d02ea0c017c2 from port abcf92b7-d4b6-41b9-80c4-6fbda749a755 Apr 26 14:14:47.247978 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:47.256395 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-355eda1c-3f52-4f0e-a2c4-eaec8a0154ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1674 microversion: 2.1 time: 0.283348 Apr 26 14:14:47.257056 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 264/532] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:46 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1674 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:47.492139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-080801e5-a53c-4b38-b3cb-0f5492c8a266 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/action" status: 202 len: 0 microversion: 2.1 time: 0.624476 Apr 26 14:14:47.496026 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 269/533] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:14:46 2022] POST /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/action => generated 0 bytes in 629 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:47.514747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-aa9851e8-49ad-4c7b-886b-17bd9c43e918 req-048a4d7a-dd8f-4201-ad65-15b2a79291f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:47.528346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-aa9851e8-49ad-4c7b-886b-17bd9c43e918 req-048a4d7a-dd8f-4201-ad65-15b2a79291f0 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:47.528784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-aa9851e8-49ad-4c7b-886b-17bd9c43e918 req-048a4d7a-dd8f-4201-ad65-15b2a79291f0 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:47.550253 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-aa9851e8-49ad-4c7b-886b-17bd9c43e918 req-048a4d7a-dd8f-4201-ad65-15b2a79291f0 service nova] Creating event network-changed:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:14:47.567225 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-aa9851e8-49ad-4c7b-886b-17bd9c43e918 req-048a4d7a-dd8f-4201-ad65-15b2a79291f0 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056044 Apr 26 14:14:47.568039 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 265/534] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:47.914337 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-955033040", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "networks": [{"uuid": "7a9cd801-4fa3-4614-975b-7aad7bd70432"}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:47.972047 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] validate_networks() for [('7a9cd801-4fa3-4614-975b-7aad7bd70432', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:14:48.278031 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:48.278781 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:48.287452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:48.287926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:48.289347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:48.289808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:48.720920 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:14:48.723601 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:14:48.724377 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:14:48.725005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:14:48.725483 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:14:48.734580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:48.735104 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:48.736009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:48.736502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:48.754522 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Getting quotas for project 044c341dbfb24ed2812bc91e85e6b06a. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:14:48.758714 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Getting quotas for user 434acf8f6a44484189c95c3504418e20 and project 044c341dbfb24ed2812bc91e85e6b06a. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:14:48.770593 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:14:48.772879 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:14:48.788772 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:48.797098 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a0556503-cf6b-4f9f-9bab-326e0f3d404d tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1674 microversion: 2.1 time: 0.525872 Apr 26 14:14:48.798635 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 266/535] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:48 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1674 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:48.921133 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-508ed9e5-d019-4f66-b75b-71987d2908ce tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011252 Apr 26 14:14:48.922985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 270/536] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:14:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:14:48.933178 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-23ff0735-d160-419d-b10f-d6d381b9924c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:48.935535 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-23ff0735-d160-419d-b10f-d6d381b9924c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:49.061735 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-23ff0735-d160-419d-b10f-d6d381b9924c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:49.068330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-23ff0735-d160-419d-b10f-d6d381b9924c tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1218 microversion: 2.1 time: 0.138925 Apr 26 14:14:49.074327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 267/537] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:48 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:49.365007 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:49.365533 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:49.382296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.382745 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.383600 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.385085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.507884 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lazy-loading 'services' on Instance uuid 04ed8647-f0ef-4959-a4ec-f0d32051f5de {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:49.522511 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-1e0e2a56-8e30-49ad-97c0-6680510cd2b9 req-bffbb56d-2fec-49ad-b110-f46543791595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "feac5dcc-29a9-415d-9898-564338c394d0", "name": "network-vif-deleted", "tag": "ca1854d6-548d-485b-8cbc-1f2457d13483"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:49.550963 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-1e0e2a56-8e30-49ad-97c0-6680510cd2b9 req-bffbb56d-2fec-49ad-b110-f46543791595 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.551332 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-1e0e2a56-8e30-49ad-97c0-6680510cd2b9 req-bffbb56d-2fec-49ad-b110-f46543791595 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.565605 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-1e0e2a56-8e30-49ad-97c0-6680510cd2b9 req-bffbb56d-2fec-49ad-b110-f46543791595 service nova] Creating event network-vif-deleted:ca1854d6-548d-485b-8cbc-1f2457d13483 for instance feac5dcc-29a9-415d-9898-564338c394d0 on hv-cinder-83513 Apr 26 14:14:49.576736 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-1e0e2a56-8e30-49ad-97c0-6680510cd2b9 req-bffbb56d-2fec-49ad-b110-f46543791595 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058499 Apr 26 14:14:49.582182 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 268/538] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:49.593580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-7db31502-55aa-4cb7-a360-f2eeec5b670e req-2fe77794-9b01-4015-bb33-84262a38ac15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:49.602249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-7db31502-55aa-4cb7-a360-f2eeec5b670e req-2fe77794-9b01-4015-bb33-84262a38ac15 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.602701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-7db31502-55aa-4cb7-a360-f2eeec5b670e req-2fe77794-9b01-4015-bb33-84262a38ac15 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.616334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-7db31502-55aa-4cb7-a360-f2eeec5b670e req-2fe77794-9b01-4015-bb33-84262a38ac15 service nova] Creating event network-changed:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:14:49.621292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-7db31502-55aa-4cb7-a360-f2eeec5b670e req-2fe77794-9b01-4015-bb33-84262a38ac15 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033001 Apr 26 14:14:49.622603 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 269/539] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:14:49.773835 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b80c27a6-4df2-4fc8-b302-75ccd32b7ad7 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments/82148e3a-af8e-49d5-a877-a97393aa9784" status: 202 len: 0 microversion: 2.1 time: 0.413736 Apr 26 14:14:49.774500 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 271/540] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:14:49 2022] DELETE /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments/82148e3a-af8e-49d5-a877-a97393aa9784 => generated 0 bytes in 415 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:49.792572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:49.794462 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:49.821362 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:49.822208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:49.826560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.827159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.834902 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.835631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.836863 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.837496 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.847812 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.849860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.890713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:49.891351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:49.893160 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lazy-loading 'fault' on Instance uuid feac5dcc-29a9-415d-9898-564338c394d0 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:49.903377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-36db37fd-1dae-45af-bd24-c5b4b0f16bc6 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.123727 Apr 26 14:14:49.908962 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 270/541] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:49 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:49.949864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:49.959970 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b30f6eeb-d77a-4e0b-bc96-2280e23e271f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 200 len: 1327 microversion: 2.1 time: 0.147978 Apr 26 14:14:49.961152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 272/542] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:49 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 1327 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:50.085167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:50.086049 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:50.092159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.092611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.093393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.094026 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.173586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:50.185450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5f18c9df-2f8c-4021-ae95-885f62fb4b53 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1222 microversion: 2.1 time: 0.104562 Apr 26 14:14:50.194830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 271/543] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:50 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1222 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:50.309115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:50.309721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:50.318946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.321403 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.322264 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.322712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.356347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-66bf13e9-be4d-49b8-a064-6334e7dd20b6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297/ips" status: 200 len: 151 microversion: 2.1 time: 0.051682 Apr 26 14:14:50.363007 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 273/544] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:14:50 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:50.368941 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b64902d5-736a-4f0d-a35b-ef04f3590397"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:50.370732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:50.378772 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.379899 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.381141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.381790 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.505875 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Invalid volume: volume b64902d5-736a-4f0d-a35b-ef04f3590397 is already attached to instances: df98b23b-b855-4fcd-ab58-771e1f55e22b Apr 26 14:14:50.506711 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 400 to user: Invalid volume: volume b64902d5-736a-4f0d-a35b-ef04f3590397 is already attached to instances: df98b23b-b855-4fcd-ab58-771e1f55e22b {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:50.511853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bbfe5043-a3a2-431e-87cb-8c6fff01b443 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147533 Apr 26 14:14:50.512928 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 272/545] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:14:50 2022] POST /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297/os-volume_attachments => generated 174 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:14:50.522423 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:50.523159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:50.530139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.530850 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.531604 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.532048 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.561885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:14:50.916734 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:50.920905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3528e6d0-b9ed-4a47-abc4-70236a1db7ea tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 204 len: 0 microversion: 2.1 time: 0.402895 Apr 26 14:14:50.921490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 274/546] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:14:50 2022] DELETE /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:14:50.929009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:50.933951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:50.934677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:50.944581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.945327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.946880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.947858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.949827 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.950477 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.951250 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:50.951699 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:50.987964 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d3fc8123-b398-4fd5-b9ea-53d25a112f82 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074849 Apr 26 14:14:50.988913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 273/547] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:50 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:14:50.995224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:50.996065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:51.003669 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:51.004366 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:51.005354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:51.005950 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:51.023217 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] HTTP exception thrown: Instance feac5dcc-29a9-415d-9898-564338c394d0 could not be found. Apr 26 14:14:51.024112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Returning 404 to user: Instance feac5dcc-29a9-415d-9898-564338c394d0 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:51.025193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-99760181-3b7d-4543-95a1-e25c6496af70 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 404 len: 111 microversion: 2.1 time: 0.034554 Apr 26 14:14:51.026014 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 274/548] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:50 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:14:51.035944 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2a872026-6d1a-4103-937e-9712f2934cb7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '.version_select at 0x7f4066c024c0>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:51.105352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2a872026-6d1a-4103-937e-9712f2934cb7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132774537" status: 202 len: 0 microversion: 2.1 time: 0.074149 Apr 26 14:14:51.106963 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 275/549] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Apr 26 14:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2132774537 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:51.151877 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:51.160563 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a560170e-2b0f-45eb-8a12-625940805aae tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1683 microversion: 2.1 time: 0.234137 Apr 26 14:14:51.162873 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 275/550] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:50 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1683 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:51.203525 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:51.213656 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:51.220552 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:51.221197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:51.222895 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:51.223482 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:51.285369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:51.292815 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2a54d929-0a87-49f4-88ae-647c59147840 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1270 microversion: 2.1 time: 0.093341 Apr 26 14:14:51.293374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 276/551] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:51 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:51.939281 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: .version_select at 0x7f4066be28b0>, body: {"keypair": {"name": "tempest-keypair-1978868222"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:51.954659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:14:51.959080 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for user 5adf6fccb73242bab32c2fdf0ea23ff3 and project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:14:51.970908 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: ERROR oslo.messaging._drivers.impl_rabbit [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [12725f8f-655f-4b7c-be4c-56a9261a8091] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 26 14:14:51.998861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:51.999812 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:52.007308 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.007777 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.008586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.009035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.039484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-85c62183-b521-4ab6-bc07-15880a6058a9 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044519 Apr 26 14:14:52.040352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 277/552] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:51 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 26 14:14:52.049606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:52.050367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:52.056204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.056880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.057823 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.058452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.135486 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] HTTP exception thrown: Instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de is not attached to volume 82148e3a-af8e-49d5-a877-a97393aa9784 Apr 26 14:14:52.136088 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Returning 404 to user: Instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de is not attached to volume 82148e3a-af8e-49d5-a877-a97393aa9784 {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:52.136926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bd372932-1986-415e-9920-ecc56350dcca tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments/82148e3a-af8e-49d5-a877-a97393aa9784" status: 404 len: 154 microversion: 2.1 time: 0.091109 Apr 26 14:14:52.137473 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 278/553] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:14:52 2022] DELETE /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de/os-volume_attachments/82148e3a-af8e-49d5-a877-a97393aa9784 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:14:52.185672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:52.186301 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:52.193050 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.193487 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.194428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.194855 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.470871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:52.480380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bab486f5-ca26-43b7-b00a-00b83ccfa32c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1683 microversion: 2.1 time: 0.298361 Apr 26 14:14:52.481404 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 279/554] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:52 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1683 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:52.486508 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:52.487463 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:52.494426 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.494878 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.495798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:52.496238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:52.838963 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:52.844961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e26a9d90-69bf-45f5-b1cb-5bcdc14bad34 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.362558 Apr 26 14:14:52.846732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 280/555] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:52 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:52.978323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO oslo.messaging._drivers.impl_rabbit [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [12725f8f-655f-4b7c-be4c-56a9261a8091] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 57766. Apr 26 14:14:53.205984 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:14:53.209770 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for user 5adf6fccb73242bab32c2fdf0ea23ff3 and project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:14:53.223152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-964e1b7c-575c-43ee-b55a-d947dd131c36 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.287770 Apr 26 14:14:53.223756 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 276/556] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:14:51 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:53.421301 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:53.421301 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:53.428391 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.428849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.429640 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.430111 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.461832 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:14:53.498075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:53.498873 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:53.510162 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.510903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.512834 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.512834 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.577310 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:53.585141 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-990c568f-1f3e-4916-a28b-1bc4a03fd3c1 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1616 microversion: 2.1 time: 0.090947 Apr 26 14:14:53.594588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 277/557] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:53 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1616 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:53.863377 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:53.864432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:53.874088 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.874886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.875851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.884534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.927289 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f6f1340d-444e-4c63-8125-6e1f12386116 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "DELETE /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 204 len: 0 microversion: 2.1 time: 0.511696 Apr 26 14:14:53.928703 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 281/558] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:14:53 2022] DELETE /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:14:53.935178 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-fcce55b8-2660-4068-8e3b-d6bc25f07991 req-c02a3813-f53e-4e6a-843a-ef38354ee7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcfc893-f654-43b1-9ff6-fdd104caa297", "name": "network-vif-deleted", "tag": "b92a86e1-039b-46bc-968d-6f19f3817a02"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:53.947310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fcce55b8-2660-4068-8e3b-d6bc25f07991 req-c02a3813-f53e-4e6a-843a-ef38354ee7b4 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:53.948003 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fcce55b8-2660-4068-8e3b-d6bc25f07991 req-c02a3813-f53e-4e6a-843a-ef38354ee7b4 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:53.962103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-fcce55b8-2660-4068-8e3b-d6bc25f07991 req-c02a3813-f53e-4e6a-843a-ef38354ee7b4 service nova] Creating event network-vif-deleted:b92a86e1-039b-46bc-968d-6f19f3817a02 for instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 on hv-cinder-83513 Apr 26 14:14:53.968550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-fcce55b8-2660-4068-8e3b-d6bc25f07991 req-c02a3813-f53e-4e6a-843a-ef38354ee7b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038072 Apr 26 14:14:53.969764 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 282/559] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:54.007563 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:54.008945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:54.021053 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:54.021833 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:54.022932 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:54.023445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:54.080463 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:54.088714 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3a9a6d2c-b5e3-49b6-b6a9-1f111bb8c729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.229415 Apr 26 14:14:54.089223 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 278/560] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:53 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:54.279980 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:54.288278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b07969c8-aed1-40ea-b3ef-22b571f8a68b tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1555 microversion: 2.1 time: 0.295298 Apr 26 14:14:54.294029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 283/561] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:53 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1555 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:54.602397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:54.603244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:54.609083 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:54.609577 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:54.610690 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:54.611121 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:54.642959 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:54.643426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:54.644055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'fault' on Instance uuid 7dcfc893-f654-43b1-9ff6-fdd104caa297 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:54.687213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:54.696644 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0797aafa-76db-4d3f-934a-efd5c9ec1b8e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 200 len: 1332 microversion: 2.1 time: 0.098874 Apr 26 14:14:54.697415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 279/562] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:54 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:55.105141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:55.108605 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:55.113209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:55.113790 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:55.114729 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:55.115270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:55.254680 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:55.262227 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1c1ccaa9-47cb-4b1f-a511-6e895955abc4 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.161076 Apr 26 14:14:55.262807 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 284/563] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:55 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:55.305695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:55.306394 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:55.313533 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:55.314025 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:55.314801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:55.315242 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:55.519450 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:55.526864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-33e9d5b6-9a4a-4f02-ae96-965b8eeb6422 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1555 microversion: 2.1 time: 0.225199 Apr 26 14:14:55.527693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 280/564] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:55 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:55.714280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:55.714897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:55.720671 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:55.721660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:55.722467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:55.722904 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:55.735673 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 could not be found. Apr 26 14:14:55.736270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:55.737771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c1755084-f6d0-484f-911b-884422718ca7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 404 len: 111 microversion: 2.1 time: 0.026808 Apr 26 14:14:55.738361 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 285/565] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:55 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:14:55.746669 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f3adb739-328c-4443-b187-5c9d2ef2a15e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '.version_select at 0x7f4066ca2790>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:55.876162 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f3adb739-328c-4443-b187-5c9d2ef2a15e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870176890" status: 202 len: 0 microversion: 2.1 time: 0.133266 Apr 26 14:14:55.876745 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 281/566] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Apr 26 14:14:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1870176890 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:55.995631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-43d4ca75-e889-42a3-af89-9190ecb318eb req-3bfabd3c-9b44-42c0-ad17-c1c486e935aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe65a20d-72c1-414f-a96e-3367b96ab242", "tag": "f6a91cab-f7de-4dd1-92ec-810971322e81"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:56.013474 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-43d4ca75-e889-42a3-af89-9190ecb318eb req-3bfabd3c-9b44-42c0-ad17-c1c486e935aa service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:56.014149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-43d4ca75-e889-42a3-af89-9190ecb318eb req-3bfabd3c-9b44-42c0-ad17-c1c486e935aa service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:56.028218 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-43d4ca75-e889-42a3-af89-9190ecb318eb req-3bfabd3c-9b44-42c0-ad17-c1c486e935aa service nova] Creating event network-changed:f6a91cab-f7de-4dd1-92ec-810971322e81 for instance fe65a20d-72c1-414f-a96e-3367b96ab242 on hv-cinder-83513 Apr 26 14:14:56.034466 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-43d4ca75-e889-42a3-af89-9190ecb318eb req-3bfabd3c-9b44-42c0-ad17-c1c486e935aa service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041877 Apr 26 14:14:56.035217 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 286/567] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:56.099323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-986663950", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "da497052-bded-497c-b389-e8193210a8cf"}], "security_groups": [{"name": "tempest-securitygroup--890295727"}], "key_name": "tempest-keypair-1978868222", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:56.281241 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:56.282361 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:56.291317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] validate_networks() for [('da497052-bded-497c-b389-e8193210a8cf', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:14:56.292945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:56.293465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:56.295251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:56.295251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:56.786322 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:56.794297 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9a1646da-604b-4ee7-b5fd-e77e5b8e4bc9 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.518186 Apr 26 14:14:56.794859 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 287/568] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:56 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:14:56.800872 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:56.801803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:56.817719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:56.818464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:56.819415 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:56.819850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.039141 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:14:57.039623 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:14:57.040021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:14:57.040456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:14:57.040886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:14:57.050526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.051053 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.051924 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.052641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.070910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:14:57.075244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Getting quotas for user 5adf6fccb73242bab32c2fdf0ea23ff3 and project 3f38bbf345384bdb9ed001c0965a3462. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:14:57.097192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:14:57.099553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:14:57.147155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:57.153180 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5d769de1-dcb9-4576-91b9-747ace90f823 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1555 microversion: 2.1 time: 0.357015 Apr 26 14:14:57.153702 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 288/569] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:56 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1555 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:57.215233 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:57.216034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:57.223011 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.223643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.224501 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.224938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.252228 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0f412693-cbac-4828-971b-a0168ec2d311 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.157774 Apr 26 14:14:57.258986 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 282/570] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:14:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:14:57.264592 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d48d5dc4-aed5-46bc-9276-4a37763b7781 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:57.265210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d48d5dc4-aed5-46bc-9276-4a37763b7781 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:57.315542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'services' on Instance uuid df98b23b-b855-4fcd-ab58-771e1f55e22b {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:57.327575 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d48d5dc4-aed5-46bc-9276-4a37763b7781 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:57.335543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d48d5dc4-aed5-46bc-9276-4a37763b7781 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1237 microversion: 2.1 time: 0.074781 Apr 26 14:14:57.344393 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 283/571] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:57 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:57.559558 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-655df96a-42bb-45a0-906c-d4635830b4e0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments/b64902d5-736a-4f0d-a35b-ef04f3590397" status: 202 len: 0 microversion: 2.1 time: 0.348738 Apr 26 14:14:57.560291 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 289/572] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:14:57 2022] DELETE /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments/b64902d5-736a-4f0d-a35b-ef04f3590397 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:14:57.571420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:57.572738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:57.580109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.580552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.581440 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.582474 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.624112 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-49294498-3504-412b-adf8-9dc5289711c3 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059072 Apr 26 14:14:57.624691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 284/573] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:57 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:57.812250 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:57.812944 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:57.819843 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.820288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.821085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:57.821521 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:57.959283 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:57.966527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-21677e85-b981-4770-86be-e6c701fec361 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.158470 Apr 26 14:14:57.967035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 290/574] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:57 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:58.050370 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-6ee61693-effe-4375-beb8-c4fcf9d8068e req-22da64ee-1148-4e27-a96d-d9fcf263d437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04ed8647-f0ef-4959-a4ec-f0d32051f5de", "name": "network-vif-deleted", "tag": "abcf92b7-d4b6-41b9-80c4-6fbda749a755"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:14:58.060481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-6ee61693-effe-4375-beb8-c4fcf9d8068e req-22da64ee-1148-4e27-a96d-d9fcf263d437 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.060928 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-6ee61693-effe-4375-beb8-c4fcf9d8068e req-22da64ee-1148-4e27-a96d-d9fcf263d437 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.072505 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-6ee61693-effe-4375-beb8-c4fcf9d8068e req-22da64ee-1148-4e27-a96d-d9fcf263d437 service nova] Creating event network-vif-deleted:abcf92b7-d4b6-41b9-80c4-6fbda749a755 for instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de on hv-cinder-83513 Apr 26 14:14:58.077349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-6ee61693-effe-4375-beb8-c4fcf9d8068e req-22da64ee-1148-4e27-a96d-d9fcf263d437 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030861 Apr 26 14:14:58.077946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 285/575] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:58.170531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:58.171156 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:58.177559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.178033 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.178988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.179422 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.209343 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.209789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.210269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lazy-loading 'fault' on Instance uuid 04ed8647-f0ef-4959-a4ec-f0d32051f5de {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:14:58.249870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '052eaf73262c40e38e14b440fd093738', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9211b70dd81f45fa8abd2cfaf151e4d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:58.257912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-21c5c291-b6b2-4bdb-8001-3ac1be7cd640 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 200 len: 1348 microversion: 2.1 time: 0.091416 Apr 26 14:14:58.260695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 291/576] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:58 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 1348 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:58.355979 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:58.357287 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:58.365320 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.366006 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.366946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.367528 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.428552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:58.436060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a0499f55-e103-4e39-b3ae-9502118da4de tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1241 microversion: 2.1 time: 0.087111 Apr 26 14:14:58.436636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 286/577] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:58 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:58.636292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:58.637299 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:58.644731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.645343 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.646242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.646680 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.676240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-993f130a-71ef-42df-af0f-63712bf4a816 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043602 Apr 26 14:14:58.676661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 292/578] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:58 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:14:58.982380 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:58.983073 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:58.989556 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.990034 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:58.990793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:58.991223 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.122924 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:59.130588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0165922a-8fb4-49a7-a8e8-9da5a83e2729 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.152069 Apr 26 14:14:59.131145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 287/579] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:58 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:59.274592 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:59.275200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] [instance: 04ed8647-f0ef-4959-a4ec-f0d32051f5de] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:59.281108 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.281553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.282337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.282768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.296948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] HTTP exception thrown: Instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de could not be found. Apr 26 14:14:59.297550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Returning 404 to user: Instance 04ed8647-f0ef-4959-a4ec-f0d32051f5de could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:14:59.298409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-144f1f92-57f4-4c24-a2ad-8674971aee58 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de" status: 404 len: 111 microversion: 2.1 time: 0.027692 Apr 26 14:14:59.298949 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 293/580] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:59 2022] GET /compute/v2.1/servers/04ed8647-f0ef-4959-a4ec-f0d32051f5de => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:14:59.307772 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3ac6995e-ba64-4ad2-896a-d0d5b48de676 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] Calling method '.version_select at 0x7f4066ca29d0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:59.407940 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3ac6995e-ba64-4ad2-896a-d0d5b48de676 tempest-TestMinimumBasicScenario-1664620931 tempest-TestMinimumBasicScenario-1664620931-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-786929227" status: 202 len: 0 microversion: 2.1 time: 0.103812 Apr 26 14:14:59.408962 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 288/581] 10.222.0.23 () {58 vars in 1268 bytes} [Tue Apr 26 14:14:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-786929227 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:14:59.452548 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:59.454010 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:59.460289 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.460850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.461798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.462424 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.543656 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:14:59.564244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6ee869f2-7019-481b-b357-ab85dec1ba1a tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1297 microversion: 2.1 time: 0.114769 Apr 26 14:14:59.570346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 294/582] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:14:59 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:14:59.687415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:59.688333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:59.695075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.695565 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.696346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.696782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.732050 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e547bf29-0be0-44f4-9e2e-6080d6c255df tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048682 Apr 26 14:14:59.738244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 289/583] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:14:59 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:14:59.806181 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:14:59.806755 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:14:59.813003 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.813663 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.814505 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:14:59.814982 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:14:59.840590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:15:00.147840 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:00.148445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:00.154270 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:00.154716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:00.155475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:00.155906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:00.207538 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d9ed76b0-b993-4705-b81c-fe31fec1f19e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 204 len: 0 microversion: 2.1 time: 0.405023 Apr 26 14:15:00.211240 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 295/584] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:14:59 2022] DELETE /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:15:00.216413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:00.217097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:00.223366 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:00.223868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:00.224639 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:00.225071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:00.290851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:00.298177 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9aa65cf5-ac9a-47d8-a3b4-ff27ce3283e3 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.154168 Apr 26 14:15:00.298748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 290/585] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:00 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:00.445405 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:00.455016 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e0b81353-76b0-4a1e-900a-c36e27286774 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1681 microversion: 2.1 time: 0.242530 Apr 26 14:15:00.459657 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 296/586] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:00 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:00.580634 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:00.581406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:00.587693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:00.588211 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:00.589053 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:00.589551 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:00.742720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:00.750154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6da80437-d085-4b87-a7e4-9cf576d322f7 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.173221 Apr 26 14:15:00.750611 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 291/587] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:00 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:01.179561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-5fc3a780-aa39-4cc5-9a5c-c7297edc9df6 req-891f1fee-36b6-4a30-b254-3d03fdb90042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe65a20d-72c1-414f-a96e-3367b96ab242", "name": "network-vif-plugged", "status": "completed", "tag": "f6a91cab-f7de-4dd1-92ec-810971322e81"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:01.188732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5fc3a780-aa39-4cc5-9a5c-c7297edc9df6 req-891f1fee-36b6-4a30-b254-3d03fdb90042 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.190674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5fc3a780-aa39-4cc5-9a5c-c7297edc9df6 req-891f1fee-36b6-4a30-b254-3d03fdb90042 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.202073 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-5fc3a780-aa39-4cc5-9a5c-c7297edc9df6 req-891f1fee-36b6-4a30-b254-3d03fdb90042 service nova] Creating event network-vif-plugged:f6a91cab-f7de-4dd1-92ec-810971322e81 for instance fe65a20d-72c1-414f-a96e-3367b96ab242 on hv-cinder-83513 Apr 26 14:15:01.208068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-5fc3a780-aa39-4cc5-9a5c-c7297edc9df6 req-891f1fee-36b6-4a30-b254-3d03fdb90042 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033436 Apr 26 14:15:01.210189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 297/588] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:01.316918 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:01.319678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:01.324642 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.325097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.325877 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.326341 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.407353 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-31106755-bc7c-4c7f-a567-a185a82bee1c req-72514054-1e09-4d5a-bc30-48574274105f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3725be-7e4d-4cea-8ca3-65650da5c3a4", "tag": "dd529bed-7d48-4697-bf08-d801037e368d"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:01.420250 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-31106755-bc7c-4c7f-a567-a185a82bee1c req-72514054-1e09-4d5a-bc30-48574274105f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.420694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-31106755-bc7c-4c7f-a567-a185a82bee1c req-72514054-1e09-4d5a-bc30-48574274105f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.435676 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-31106755-bc7c-4c7f-a567-a185a82bee1c req-72514054-1e09-4d5a-bc30-48574274105f service nova] Creating event network-changed:dd529bed-7d48-4697-bf08-d801037e368d for instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 on hv-cinder-83513 Apr 26 14:15:01.454496 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-31106755-bc7c-4c7f-a567-a185a82bee1c req-72514054-1e09-4d5a-bc30-48574274105f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048704 Apr 26 14:15:01.456104 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 298/589] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:01.474222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:01.475049 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:01.482987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.483899 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.484997 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.485584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.609019 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:01.616793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-07d05938-95db-4355-925e-8550f45270a5 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.303551 Apr 26 14:15:01.617017 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 292/590] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:01 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:01.769373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:01.770175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:01.779429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.779884 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.780668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:01.781159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:01.799589 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:01.809045 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-161082b1-5066-4a09-b769-a93c2835eaba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1681 microversion: 2.1 time: 0.340315 Apr 26 14:15:01.809666 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 299/591] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:01 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1681 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:02.039713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:02.047683 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-373fcf27-0141-4575-9c91-c5c54f228750 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.283444 Apr 26 14:15:02.048508 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 293/592] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:01 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:02.632877 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:02.639731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:02.639731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:02.640207 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:02.640990 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:02.641429 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:02.826700 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:02.827633 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:02.834971 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:02.835419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:02.836206 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:02.836639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:03.156110 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:03.165705 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-63a2148d-d6bb-4783-9861-ec36287eb9c6 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1318 microversion: 2.1 time: 0.536628 Apr 26 14:15:03.167788 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 300/593] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:02 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1318 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:03.171595 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:03.172205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:03.179001 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:03.179461 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:03.180259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:03.180789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:03.226704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:03.234336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-dec3538e-ae3d-4dff-b6f5-41cd6ae19bfc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1681 microversion: 2.1 time: 0.411705 Apr 26 14:15:03.234911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 294/594] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:02 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:03.425940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:03.444860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-975a0da1-ee7b-44ab-995e-a6898cc84181 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.265965 Apr 26 14:15:03.445914 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 301/595] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:03 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:03.883078 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-460bdc3f-0b4a-4d44-81b4-5dd397d28503 req-4926b074-7f0f-44a7-8d74-f7c19caf69a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df98b23b-b855-4fcd-ab58-771e1f55e22b", "name": "network-vif-deleted", "tag": "ede1cf67-87e7-4b05-824d-155ba5205045"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:03.894512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-460bdc3f-0b4a-4d44-81b4-5dd397d28503 req-4926b074-7f0f-44a7-8d74-f7c19caf69a7 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:03.894912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-460bdc3f-0b4a-4d44-81b4-5dd397d28503 req-4926b074-7f0f-44a7-8d74-f7c19caf69a7 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:03.919378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-460bdc3f-0b4a-4d44-81b4-5dd397d28503 req-4926b074-7f0f-44a7-8d74-f7c19caf69a7 service nova] Creating event network-vif-deleted:ede1cf67-87e7-4b05-824d-155ba5205045 for instance df98b23b-b855-4fcd-ab58-771e1f55e22b on hv-cinder-83513 Apr 26 14:15:03.930639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-460bdc3f-0b4a-4d44-81b4-5dd397d28503 req-4926b074-7f0f-44a7-8d74-f7c19caf69a7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050940 Apr 26 14:15:03.931277 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 295/596] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:15:04.183516 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:04.184150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:04.196095 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.196553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.197343 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.197784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.255883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:04.257305 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:04.266241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.266810 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.267449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.268418 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.301780 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.302238 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.302683 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'fault' on Instance uuid df98b23b-b855-4fcd-ab58-771e1f55e22b {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:04.352154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:04.360266 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-293b77b5-118e-4603-af62-148a1b56201a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 200 len: 1330 microversion: 2.1 time: 0.109704 Apr 26 14:15:04.361037 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 296/597] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:04 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:04.429485 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:04.446224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5f2b5b38-635a-4341-b086-e38ea684629b tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1507 microversion: 2.1 time: 0.266572 Apr 26 14:15:04.446808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 302/598] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:04 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1507 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:04.461537 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:04.462464 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:04.464208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "816fa12d-0adb-4f7b-8988-a7dfec4a602b", "device": "/dev/sdb"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:04.465892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:04.469110 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.469786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.470837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.471977 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.472879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.473408 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.474265 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:04.474758 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:04.676909 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:04.681728 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c28ab473-24bb-41c8-9662-7cc6725458ec tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.223877 Apr 26 14:15:04.682546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 297/599] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:04 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:05.344433 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c20a595f-20d1-4015-be55-6cd59f842785 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "POST /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884534 Apr 26 14:15:05.352875 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 303/600] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:15:04 2022] POST /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:15:05.378814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:05.379553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:05.386432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:05.387093 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:05.388055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:05.388647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:05.417423 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance df98b23b-b855-4fcd-ab58-771e1f55e22b could not be found. Apr 26 14:15:05.418256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance df98b23b-b855-4fcd-ab58-771e1f55e22b could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:15:05.419510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-002f9171-2d01-4b99-be98-ae72702722a5 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 404 len: 111 microversion: 2.1 time: 0.044583 Apr 26 14:15:05.420769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 298/601] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:05 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:15:05.434347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1ceec92b-959d-4064-8d0d-8ded41859485 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '.version_select at 0x7f4066c74040>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:05.550527 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1ceec92b-959d-4064-8d0d-8ded41859485 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-389141440" status: 202 len: 0 microversion: 2.1 time: 0.124808 Apr 26 14:15:05.555569 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 304/602] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Apr 26 14:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-389141440 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:15:05.701424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:05.702747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:05.716228 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:05.716904 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:05.717454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:05.717993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:05.854629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:05.862502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ed3595a6-f032-45a1-8bc0-20bdc6c39431 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.166586 Apr 26 14:15:05.863147 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 299/603] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:05 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:06.421798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-eef9a7f0-369c-4d52-825d-a874cafe3b7c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: .version_select at 0x7f4066c8daf0>, body: {"keypair": {"name": "tempest-keypair-1604979815"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:06.436610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-eef9a7f0-369c-4d52-825d-a874cafe3b7c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:15:06.443389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-eef9a7f0-369c-4d52-825d-a874cafe3b7c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:15:06.878801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:06.879549 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:06.886159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:06.886736 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:06.887706 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:06.888159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:06.910664 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-eef9a7f0-369c-4d52-825d-a874cafe3b7c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:15:06.915701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-eef9a7f0-369c-4d52-825d-a874cafe3b7c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:15:06.931261 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-eef9a7f0-369c-4d52-825d-a874cafe3b7c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.513841 Apr 26 14:15:06.938189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 305/604] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:15:06 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:07.034469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:07.043333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3e4f4ade-f414-4754-bb5c-97ec7ad2e9bb tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.168448 Apr 26 14:15:07.043914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 300/605] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:06 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:08.061955 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:08.065325 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:08.078135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:08.078961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:08.080005 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:08.080700 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:08.318563 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:08.326368 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ad92e6cc-bca0-45e9-b878-fedb600de711 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.269494 Apr 26 14:15:08.336627 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 306/606] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:08 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:09.151534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-3d79ca11-149a-4a77-98bc-9dbd48e9ec6d req-10778123-08bf-4c56-8167-58ac52eb549f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3725be-7e4d-4cea-8ca3-65650da5c3a4", "name": "network-vif-plugged", "status": "completed", "tag": "dd529bed-7d48-4697-bf08-d801037e368d"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:09.176024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3d79ca11-149a-4a77-98bc-9dbd48e9ec6d req-10778123-08bf-4c56-8167-58ac52eb549f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:09.176024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3d79ca11-149a-4a77-98bc-9dbd48e9ec6d req-10778123-08bf-4c56-8167-58ac52eb549f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:09.176024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-3d79ca11-149a-4a77-98bc-9dbd48e9ec6d req-10778123-08bf-4c56-8167-58ac52eb549f service nova] Creating event network-vif-plugged:dd529bed-7d48-4697-bf08-d801037e368d for instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 on hv-cinder-83513 Apr 26 14:15:09.176874 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-3d79ca11-149a-4a77-98bc-9dbd48e9ec6d req-10778123-08bf-4c56-8167-58ac52eb549f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029729 Apr 26 14:15:09.177458 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 301/607] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:09.342885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:09.343472 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:09.349923 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:09.350447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:09.351306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:09.351743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:09.524336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1910626404", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db62da73-59c6-4f6f-98fa-3d9fee96e03d"}], "security_groups": [{"name": "tempest-securitygroup--129126131"}], "key_name": "tempest-keypair-1604979815", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:09.547096 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:09.560307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e3963157-85c6-4f81-8219-26d50e3aab1e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.221335 Apr 26 14:15:09.563428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 307/608] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:09 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:09.711077 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] validate_networks() for [('db62da73-59c6-4f6f-98fa-3d9fee96e03d', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:15:10.339512 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:15:10.340135 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:15:10.340385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:15:10.340811 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:15:10.341213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:15:10.350289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:10.350686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:10.354373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:10.354373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:10.368809 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:15:10.372622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:15:10.383943 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:15:10.386303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:15:10.517105 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0b70083c-1c40-42d4-a7c8-6274d69e8f28 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.004056 Apr 26 14:15:10.518166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 302/609] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:15:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 26 14:15:10.528035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0b595943-bf48-4c84-81ee-501b231d10a4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:10.528793 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0b595943-bf48-4c84-81ee-501b231d10a4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:10.580632 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:10.581246 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:10.586009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0b595943-bf48-4c84-81ee-501b231d10a4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:10.588040 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:10.588493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:10.589268 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:10.589868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:10.593253 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0b595943-bf48-4c84-81ee-501b231d10a4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1242 microversion: 2.1 time: 0.068978 Apr 26 14:15:10.598097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 308/610] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:10 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:10.746535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:10.754672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-cfd7f9a1-6e06-4fb1-bff7-fbf7417bdf44 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1362 microversion: 2.1 time: 0.177864 Apr 26 14:15:10.764179 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 303/611] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:10 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:11.610920 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:11.611643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:11.618859 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:11.619317 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:11.620085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:11.620559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:11.774062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:11.775322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:11.782535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:11.783886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:11.784850 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:11.785498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:11.915511 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:11.921088 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a03d4de9-7f0e-4378-82c6-dae98e78ea44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1246 microversion: 2.1 time: 0.313973 Apr 26 14:15:11.931968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 309/612] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:11 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1246 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:12.016747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:12.024371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bc37df81-56aa-4b26-9308-580a91721561 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1548 microversion: 2.1 time: 0.254788 Apr 26 14:15:12.025170 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 304/613] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:11 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1548 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:12.041636 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:12.042167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:12.048053 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:12.048508 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:12.049368 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:12.049808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:12.437683 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f7e328e2-eb3e-434e-a2f9-027ccc1c1a25 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.399643 Apr 26 14:15:12.442145 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 310/614] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:15:12 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-interface => generated 284 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:15:12.938293 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:12.942798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:12.957327 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:12.958250 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:12.959530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:12.960188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:13.167923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:13.179208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a4b90528-6615-4f32-9e49-f7236bd02f4c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1312 microversion: 2.1 time: 0.244748 Apr 26 14:15:13.182077 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 305/615] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:12 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1312 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:13.861166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-b1695af2-b0d7-443e-b57f-9ab4b3d1073c req-b764da33-a9ef-4705-a731-8528a626cbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc3725be-7e4d-4cea-8ca3-65650da5c3a4", "tag": "dd529bed-7d48-4697-bf08-d801037e368d"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:13.869879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-b1695af2-b0d7-443e-b57f-9ab4b3d1073c req-b764da33-a9ef-4705-a731-8528a626cbda service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:13.870358 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-b1695af2-b0d7-443e-b57f-9ab4b3d1073c req-b764da33-a9ef-4705-a731-8528a626cbda service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:13.882022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-b1695af2-b0d7-443e-b57f-9ab4b3d1073c req-b764da33-a9ef-4705-a731-8528a626cbda service nova] Creating event network-changed:dd529bed-7d48-4697-bf08-d801037e368d for instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 on hv-cinder-83513 Apr 26 14:15:13.887390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-b1695af2-b0d7-443e-b57f-9ab4b3d1073c req-b764da33-a9ef-4705-a731-8528a626cbda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030337 Apr 26 14:15:13.887991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 311/616] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:14.204811 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:14.204811 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:14.204811 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:14.204811 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:14.205870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:14.206802 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:14.338198 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:15:14.344129 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: Tue Apr 26 14:15:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:15:14.386196 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:14.394488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2473696c-f11e-4654-af64-1d0dc81aed46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.201353 Apr 26 14:15:14.395704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 306/617] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:14 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:14.677606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-cc8399cc-0f4a-4e4a-a534-7d0923c1378d req-4cbf3f53-0be9-4c29-8cfd-4139714b1133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b4e8add-c541-4ae3-9b22-5144661eee8d", "tag": "34dce262-591f-43ff-9324-4aa5369a0a47"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:14.686268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-cc8399cc-0f4a-4e4a-a534-7d0923c1378d req-4cbf3f53-0be9-4c29-8cfd-4139714b1133 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:14.686948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-cc8399cc-0f4a-4e4a-a534-7d0923c1378d req-4cbf3f53-0be9-4c29-8cfd-4139714b1133 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:14.699610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-cc8399cc-0f4a-4e4a-a534-7d0923c1378d req-4cbf3f53-0be9-4c29-8cfd-4139714b1133 service nova] Creating event network-changed:34dce262-591f-43ff-9324-4aa5369a0a47 for instance 8b4e8add-c541-4ae3-9b22-5144661eee8d on hv-cinder-83513 Apr 26 14:15:14.704441 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-cc8399cc-0f4a-4e4a-a534-7d0923c1378d req-4cbf3f53-0be9-4c29-8cfd-4139714b1133 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030817 Apr 26 14:15:14.705627 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 312/618] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:15.412011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:15.415145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:15.419309 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:15.419760 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:15.420534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:15.420974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:15.577747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:15.580082 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-23864a52-a958-4e15-97f9-d29e53c14738 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.171937 Apr 26 14:15:15.581387 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 307/619] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:15 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:16.605753 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:16.606500 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:16.619091 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:16.619538 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:16.620314 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:16.620742 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:17.282631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:17.293614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c4eeeabb-65ba-407c-a345-992a0ef8017b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.694530 Apr 26 14:15:17.294432 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 313/620] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:16 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:18.311492 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:18.312115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:18.318926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:18.319376 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:18.320156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:18.320594 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:18.464297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:18.471937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b09feafe-ad2a-4e91-9cce-734ba6c38ca8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.164222 Apr 26 14:15:18.472511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 308/621] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:18 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:19.489126 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:19.489850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:19.496230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:19.496677 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:19.497449 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:19.497879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:19.737436 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:19.748455 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-444c2b5c-ea55-4b98-a368-092b65da863d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.262505 Apr 26 14:15:19.749382 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 314/622] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:19 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:20.764938 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:20.765618 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:20.772718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:20.773248 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:20.774125 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:20.774688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:20.923034 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:20.930623 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9efad1e4-5077-4fc5-a47f-47aaa304fa82 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.169831 Apr 26 14:15:20.931183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 309/623] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:20 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:21.947864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:21.948614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:21.955661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:21.956253 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:21.957133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:21.957650 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:22.103034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:22.110529 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ee2c5764-a25b-4746-a05c-660e72dace5e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.167014 Apr 26 14:15:22.111243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 315/624] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:21 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:22.390741 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:22.391218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:22.397424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:22.397869 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:22.398716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:22.403222 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:22.480595 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'services' on Instance uuid 1af8e557-0521-4ed6-971f-dfa80ec191c9 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:22.777834 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f7bf4d97-ad76-45e3-9b87-14768bbb98cf tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments/bba9c4dc-db04-48b1-983b-4f3226749dff" status: 202 len: 0 microversion: 2.1 time: 0.389977 Apr 26 14:15:22.781382 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 310/625] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:15:22 2022] DELETE /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments/bba9c4dc-db04-48b1-983b-4f3226749dff => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:15:22.791767 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:22.793100 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:22.800086 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:22.800765 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:22.801694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:22.802175 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:22.849069 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-44cc94a3-65bc-4081-90e1-386c5032847e tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064437 Apr 26 14:15:22.851019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 316/626] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:15:22 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:23.129130 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:23.130140 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:23.137578 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:23.138070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:23.138899 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:23.139479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:23.351330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:23.365736 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-87a6ad70-bd4e-4fab-9401-2122a24b7db4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.241196 Apr 26 14:15:23.370247 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 311/627] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:23 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:23.868310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:23.869322 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:23.876911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:23.877419 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:23.878451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:23.878896 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:23.911459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8e06e21f-0835-42db-adf1-ee6e12931549 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051997 Apr 26 14:15:23.912576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 317/628] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:15:23 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:24.384084 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:24.384761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:24.397212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:24.398778 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:24.399725 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:24.400319 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:24.569802 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:24.585687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-43860659-d2f1-4bef-bde4-0b766f314897 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.205598 Apr 26 14:15:24.586410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 312/629] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:24 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:24.927107 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:24.928244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:24.934465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:24.935382 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:24.936431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:24.936963 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:24.972085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-15d21018-1985-4503-98fc-5aeff1e457f7 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050619 Apr 26 14:15:24.977448 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 318/630] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:15:24 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:15:25.051624 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:25.052538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:25.058815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.059272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.060239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.060743 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.086129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:15:25.365774 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-feeff229-2975-4633-bfc3-8b1eb128e234 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "DELETE /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 204 len: 0 microversion: 2.1 time: 0.318376 Apr 26 14:15:25.366406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 313/631] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:15:25 2022] DELETE /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:15:25.374673 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:25.375520 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:25.381999 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.382477 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.383551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.383995 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.531313 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:25.541635 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-dec09a37-c34a-471d-8a5e-f303cf9208b3 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1688 microversion: 2.1 time: 0.170933 Apr 26 14:15:25.543221 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 319/632] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:25 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:25.604815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:25.605686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:25.620807 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.624606 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.625591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.628598 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.657556 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:25.659275 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:25.667210 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.667985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.669346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:25.669943 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:25.787854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lazy-loading 'services' on Instance uuid fe65a20d-72c1-414f-a96e-3367b96ab242 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:25.924359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:25.932171 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6a8abb76-7760-4b2d-94dc-4392746f3160 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.332655 Apr 26 14:15:25.935039 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 314/633] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:25 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:26.040814 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-82392f01-980c-4c0d-ad11-2619e494a24a tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242/os-volume_attachments/816fa12d-0adb-4f7b-8988-a7dfec4a602b" status: 202 len: 0 microversion: 2.1 time: 0.390191 Apr 26 14:15:26.041410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 320/634] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:15:25 2022] DELETE /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242/os-volume_attachments/816fa12d-0adb-4f7b-8988-a7dfec4a602b => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:15:26.422575 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-bdb4cd37-4c26-416b-bd8d-b04ffb3b873a req-65894ed5-f36b-499d-8de8-4a0669e94f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4e8add-c541-4ae3-9b22-5144661eee8d", "name": "network-vif-plugged", "status": "completed", "tag": "34dce262-591f-43ff-9324-4aa5369a0a47"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:26.430670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-bdb4cd37-4c26-416b-bd8d-b04ffb3b873a req-65894ed5-f36b-499d-8de8-4a0669e94f2c service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:26.431109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-bdb4cd37-4c26-416b-bd8d-b04ffb3b873a req-65894ed5-f36b-499d-8de8-4a0669e94f2c service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:26.452100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-bdb4cd37-4c26-416b-bd8d-b04ffb3b873a req-65894ed5-f36b-499d-8de8-4a0669e94f2c service nova] Creating event network-vif-plugged:34dce262-591f-43ff-9324-4aa5369a0a47 for instance 8b4e8add-c541-4ae3-9b22-5144661eee8d on hv-cinder-83513 Apr 26 14:15:26.458433 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-bdb4cd37-4c26-416b-bd8d-b04ffb3b873a req-65894ed5-f36b-499d-8de8-4a0669e94f2c service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039388 Apr 26 14:15:26.459031 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 315/635] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:26.560849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:26.561784 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:26.568849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:26.569222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:26.570542 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:26.571158 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:26.742416 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:26.757630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-243cff71-76d8-4b11-b5f4-78f111350859 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1688 microversion: 2.1 time: 0.200689 Apr 26 14:15:26.758888 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 321/636] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:26 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:26.951117 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:26.952515 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:26.970865 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:26.971750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:26.973279 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:26.973931 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.165732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:27.167456 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:27.175354 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:27.175879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.176889 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:27.177399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.192656 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:27.205103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:15:27.208894 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-29e0baa9-a1b7-4839-9c67-7855c2c9bf44 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.262907 Apr 26 14:15:27.210134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 316/637] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:26 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:27.543312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-49a3d3d5-836e-45bf-9cfa-50256ee8a0bd tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 204 len: 0 microversion: 2.1 time: 0.381703 Apr 26 14:15:27.543905 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 322/638] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:15:27 2022] DELETE /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 26 14:15:27.553022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:27.553712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:27.559682 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:27.560125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.561097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:27.561711 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.606975 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-00ecf65e-6c06-4d70-9760-080c61470fdd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Action: 'create', calling method: .version_select at 0x7f4066be2dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-825254602"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:27.622654 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-00ecf65e-6c06-4d70-9760-080c61470fdd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:15:27.628100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-00ecf65e-6c06-4d70-9760-080c61470fdd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for user 9cd225533a1e48a3a8f03339af74b851 and project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:15:27.700706 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:27.712090 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a52829f0-17d0-4f8e-a1b4-b218530dc03e tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1513 microversion: 2.1 time: 0.163686 Apr 26 14:15:27.712645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 323/639] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:27 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:27.776276 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:27.777045 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:27.784209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:27.784732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.785581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:27.786054 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:27.812408 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-00ecf65e-6c06-4d70-9760-080c61470fdd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:15:27.816625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-00ecf65e-6c06-4d70-9760-080c61470fdd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for user 9cd225533a1e48a3a8f03339af74b851 and project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'key_pairs'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:15:27.830283 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-00ecf65e-6c06-4d70-9760-080c61470fdd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.405549 Apr 26 14:15:27.830884 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 317/640] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:15:27 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:27.931452 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:27.939153 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d76e6104-67bb-410e-9930-f8e4375beb22 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1688 microversion: 2.1 time: 0.166946 Apr 26 14:15:27.943238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 324/641] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:27 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:28.226640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:28.227337 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:28.234755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:28.235224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:28.237062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:28.237501 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:28.640940 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:28.648647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-03288203-9d95-467c-b871-3e33b0df42ec tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1367 microversion: 2.1 time: 0.426382 Apr 26 14:15:28.649299 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 318/642] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:28 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1367 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:28.728676 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:28.730219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:28.745629 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:28.745868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:28.746807 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:28.747313 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:28.885288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:28.893924 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4de6a804-47b0-4e35-bf58-948034a05331 tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1513 microversion: 2.1 time: 0.169001 Apr 26 14:15:28.894760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 325/643] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:28 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:28.957094 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:28.957765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:28.963511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:28.964026 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:28.964794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:28.965267 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:29.127936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:29.137742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1afa1635-ba1b-4ce1-b041-afa316e525d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1688 microversion: 2.1 time: 0.185057 Apr 26 14:15:29.138364 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 319/644] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:28 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:29.666911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:29.667763 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:29.677071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:29.677590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:29.678430 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:29.678860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:29.911493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:29.912189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:29.919073 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:29.919521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:29.920280 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:29.920704 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:30.025166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:30.034927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c1efd8fb-674d-4219-96b8-e5cc60d4bb1c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1558 microversion: 2.1 time: 0.372943 Apr 26 14:15:30.035391 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 326/645] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:29 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1558 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:30.051307 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:30.051720 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:30.057910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:30.058396 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:30.059169 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:30.059371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:30.059984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:30.068930 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-98acff17-db77-4083-bb58-45dc8c13ca9d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1513 microversion: 2.1 time: 0.161855 Apr 26 14:15:30.069517 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 320/646] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:29 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:30.155867 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:30.156665 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:30.163285 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:30.164124 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:30.165246 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:30.165790 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:30.300729 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:30.308200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b24cafed-82ae-4108-92c1-1660adb108ea tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1688 microversion: 2.1 time: 0.156322 Apr 26 14:15:30.308824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 321/647] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:30 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:30.312714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-88c06916-22da-4eab-9ace-6e8040b4c16c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.265322 Apr 26 14:15:30.313302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 327/648] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:15:30 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-interface => generated 285 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:15:30.862703 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-237e7f90-5bf7-4f12-adfb-93084174d9ac req-a268379f-a135-40b0-83d1-18b395767a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe65a20d-72c1-414f-a96e-3367b96ab242", "name": "network-vif-deleted", "tag": "f6a91cab-f7de-4dd1-92ec-810971322e81"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:30.873011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-237e7f90-5bf7-4f12-adfb-93084174d9ac req-a268379f-a135-40b0-83d1-18b395767a76 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:30.873470 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-237e7f90-5bf7-4f12-adfb-93084174d9ac req-a268379f-a135-40b0-83d1-18b395767a76 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:30.885805 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-237e7f90-5bf7-4f12-adfb-93084174d9ac req-a268379f-a135-40b0-83d1-18b395767a76 service nova] Creating event network-vif-deleted:f6a91cab-f7de-4dd1-92ec-810971322e81 for instance fe65a20d-72c1-414f-a96e-3367b96ab242 on hv-cinder-83513 Apr 26 14:15:30.903079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-237e7f90-5bf7-4f12-adfb-93084174d9ac req-a268379f-a135-40b0-83d1-18b395767a76 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135055 Apr 26 14:15:30.904305 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 322/649] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:31.089369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:31.090765 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:31.099231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:31.099939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:31.101103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:31.101701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:31.161420 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:31.161988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:31.162515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lazy-loading 'fault' on Instance uuid fe65a20d-72c1-414f-a96e-3367b96ab242 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:31.327813 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:31.328672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:31.336104 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:31.337055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:31.337904 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:31.338413 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:31.480395 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '434acf8f6a44484189c95c3504418e20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '044c341dbfb24ed2812bc91e85e6b06a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:31.487237 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:31.506896 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-03c97138-0834-475e-b6ce-f30b94e7d39d tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 200 len: 1308 microversion: 2.1 time: 0.424320 Apr 26 14:15:31.516677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0e534885-318e-468b-932c-568b3abc3249 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1621 microversion: 2.1 time: 0.190708 Apr 26 14:15:31.516814 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 328/650] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:31 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:31.516930 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 323/651] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:31 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1621 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:31.612098 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-c36f73ca-fd27-4b1d-97b9-7127f0a30ed6 req-bbf6e04e-5aaf-4cc3-ab45-bdd7269b2a93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b4e8add-c541-4ae3-9b22-5144661eee8d", "tag": "34dce262-591f-43ff-9324-4aa5369a0a47"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:31.624046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-c36f73ca-fd27-4b1d-97b9-7127f0a30ed6 req-bbf6e04e-5aaf-4cc3-ab45-bdd7269b2a93 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:31.627796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-c36f73ca-fd27-4b1d-97b9-7127f0a30ed6 req-bbf6e04e-5aaf-4cc3-ab45-bdd7269b2a93 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:31.640792 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-c36f73ca-fd27-4b1d-97b9-7127f0a30ed6 req-bbf6e04e-5aaf-4cc3-ab45-bdd7269b2a93 service nova] Creating event network-changed:34dce262-591f-43ff-9324-4aa5369a0a47 for instance 8b4e8add-c541-4ae3-9b22-5144661eee8d on hv-cinder-83513 Apr 26 14:15:31.646258 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-c36f73ca-fd27-4b1d-97b9-7127f0a30ed6 req-bbf6e04e-5aaf-4cc3-ab45-bdd7269b2a93 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037709 Apr 26 14:15:31.651166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 329/652] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:32.524210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:32.524814 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] [instance: fe65a20d-72c1-414f-a96e-3367b96ab242] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:32.531571 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:32.532325 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:32.533693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:32.534888 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:32.535818 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:32.536657 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:32.549860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:32.551922 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] HTTP exception thrown: Instance fe65a20d-72c1-414f-a96e-3367b96ab242 could not be found. Apr 26 14:15:32.552086 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:32.553570 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:32.553670 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:32.554454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] Returning 404 to user: Instance fe65a20d-72c1-414f-a96e-3367b96ab242 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:15:32.555366 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5ffac47d-4740-4357-805d-25e44635f80f tempest-VolumesSnapshotTestJSON-1889114263 tempest-VolumesSnapshotTestJSON-1889114263-project] 10.222.0.23 "GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242" status: 404 len: 111 microversion: 2.1 time: 0.034992 Apr 26 14:15:32.560189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 324/653] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:32 2022] GET /compute/v2.1/servers/fe65a20d-72c1-414f-a96e-3367b96ab242 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:15:32.605306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:32.605306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:32.605306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'fault' on Instance uuid 1af8e557-0521-4ed6-971f-dfa80ec191c9 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:32.688788 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:32.703393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b00a04ad-9aeb-42e6-a393-cfef53623489 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 200 len: 1335 microversion: 2.1 time: 0.174191 Apr 26 14:15:32.708163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 330/654] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:32 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 1335 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:32.932454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-a3855b1d-ab17-432e-bf08-0f6256733d75 req-7e875a1f-0dbf-491f-87e6-a1c055d5eeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af8e557-0521-4ed6-971f-dfa80ec191c9", "name": "network-vif-deleted", "tag": "e48d3e25-6975-41a5-953a-e283cc06a7c3"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:32.944765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-a3855b1d-ab17-432e-bf08-0f6256733d75 req-7e875a1f-0dbf-491f-87e6-a1c055d5eeb7 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:32.946092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-a3855b1d-ab17-432e-bf08-0f6256733d75 req-7e875a1f-0dbf-491f-87e6-a1c055d5eeb7 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:32.968540 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-a3855b1d-ab17-432e-bf08-0f6256733d75 req-7e875a1f-0dbf-491f-87e6-a1c055d5eeb7 service nova] Creating event network-vif-deleted:e48d3e25-6975-41a5-953a-e283cc06a7c3 for instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 on hv-cinder-83513 Apr 26 14:15:32.983323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-a3855b1d-ab17-432e-bf08-0f6256733d75 req-7e875a1f-0dbf-491f-87e6-a1c055d5eeb7 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053192 Apr 26 14:15:32.984330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 325/655] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:33.724108 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:33.724714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 1af8e557-0521-4ed6-971f-dfa80ec191c9] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:33.731695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:33.732383 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:33.733328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:33.733764 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:33.759355 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] HTTP exception thrown: Instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 could not be found. Apr 26 14:15:33.759899 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Returning 404 to user: Instance 1af8e557-0521-4ed6-971f-dfa80ec191c9 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:15:33.760718 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-eaec2f6a-6103-4173-b2f0-379533e13057 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9" status: 404 len: 111 microversion: 2.1 time: 0.041333 Apr 26 14:15:33.761279 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 331/656] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:33 2022] GET /compute/v2.1/servers/1af8e557-0521-4ed6-971f-dfa80ec191c9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:15:33.774013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-34285373-00a7-4333-8143-a26def707c47 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '.version_select at 0x7f4066a9edc0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:33.865431 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-34285373-00a7-4333-8143-a26def707c47 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-876694622" status: 202 len: 0 microversion: 2.1 time: 0.099584 Apr 26 14:15:33.866782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 326/657] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Apr 26 14:15:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-876694622 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:15:40.447724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:40.448234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:40.455074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:40.456013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:40.456716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:40.456716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:40.480626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:15:40.812103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d81c92dc-fc92-4591-904c-a63577ffd659 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 204 len: 0 microversion: 2.1 time: 0.367879 Apr 26 14:15:40.812626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 332/658] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:15:40 2022] DELETE /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:15:40.822556 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:40.823406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:40.830325 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:40.830761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:40.831526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:40.831963 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:40.968979 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:40.977072 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3649c0bc-c326-4eeb-a9ff-a047780ee538 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1508 microversion: 2.1 time: 0.159738 Apr 26 14:15:40.977661 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 327/659] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:40 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:41.995486 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:41.996179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:42.003465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:42.003917 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:42.004695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:42.005140 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:42.154139 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:42.162400 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7bc01cb3-4161-425a-823f-d59fcfed6720 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1508 microversion: 2.1 time: 0.170951 Apr 26 14:15:42.162978 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 333/660] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:41 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:43.179997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:43.180597 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:43.186789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:43.187240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:43.188002 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:43.188438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:43.333856 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:43.350522 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-32866883-7bee-4c57-b14e-325a7d0fe81a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1508 microversion: 2.1 time: 0.174255 Apr 26 14:15:43.351101 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 328/661] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:43 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:43.380326 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-aaf986d2-27e4-4667-a349-d515a3510b88 req-fc7988c7-3d45-4bd4-aeeb-4dd1ac216350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5c588d0-aa8c-4db6-aba6-ff2863b26ad7", "name": "network-vif-deleted", "tag": "0e992724-8bbd-4a49-96d5-fa786b2405ab"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:43.389622 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-aaf986d2-27e4-4667-a349-d515a3510b88 req-fc7988c7-3d45-4bd4-aeeb-4dd1ac216350 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:43.390122 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-aaf986d2-27e4-4667-a349-d515a3510b88 req-fc7988c7-3d45-4bd4-aeeb-4dd1ac216350 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:43.401484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-aaf986d2-27e4-4667-a349-d515a3510b88 req-fc7988c7-3d45-4bd4-aeeb-4dd1ac216350 service nova] Creating event network-vif-deleted:0e992724-8bbd-4a49-96d5-fa786b2405ab for instance b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 on hv-cinder-83513 Apr 26 14:15:43.406512 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-aaf986d2-27e4-4667-a349-d515a3510b88 req-fc7988c7-3d45-4bd4-aeeb-4dd1ac216350 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030767 Apr 26 14:15:43.407310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 334/662] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:15:44.367579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:44.368336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:44.374955 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:44.378950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:44.378950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:44.378950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:44.408084 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:44.408617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:44.409054 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'fault' on Instance uuid b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:44.447784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:44.454402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e456028a-9f8c-4d24-8f2c-d1b7b8452902 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 200 len: 1312 microversion: 2.1 time: 0.090666 Apr 26 14:15:44.454955 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 329/663] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:44 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 1312 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:45.472201 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:45.472897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: b5c588d0-aa8c-4db6-aba6-ff2863b26ad7] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:45.480137 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:45.480581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:45.481340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:45.481774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:45.495880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] HTTP exception thrown: Instance b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 could not be found. Apr 26 14:15:45.496468 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Returning 404 to user: Instance b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:15:45.497298 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9a258059-3f73-453e-8c6d-1d11710bf073 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7" status: 404 len: 111 microversion: 2.1 time: 0.029285 Apr 26 14:15:45.497838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 335/664] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:45 2022] GET /compute/v2.1/servers/b5c588d0-aa8c-4db6-aba6-ff2863b26ad7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:15:45.505646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:45.506183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:45.512411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:45.512851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:45.515647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:45.515647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:45.540505 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:15:45.851501 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a92e7210-f03c-4ec6-9c73-1564ed2d85f1 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "DELETE /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 204 len: 0 microversion: 2.1 time: 0.349309 Apr 26 14:15:45.852095 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 330/665] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:15:45 2022] DELETE /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:15:45.859892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:45.863901 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:45.866463 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:45.866908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:45.867664 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:45.868098 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:46.004176 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:46.011884 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8d9c11a4-0eb9-47f2-8240-c0e920f43a72 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.155747 Apr 26 14:15:46.012435 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 336/666] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:45 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:47.029390 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:47.030117 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:47.036324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:47.036780 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:47.037546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:47.038001 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:47.167125 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:47.174475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4f6569dc-8925-4ea6-a97e-5e54a4d7e260 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.149174 Apr 26 14:15:47.175021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 331/667] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:47 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:48.192246 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:48.192878 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:48.199224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:48.199673 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:48.200435 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:48.200870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:48.331654 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:48.338869 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4b68ab49-a2d2-436b-b5c0-af17a0e05dc2 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.151069 Apr 26 14:15:48.339433 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 337/668] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:48 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:49.355805 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:49.356410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:49.362678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:49.363126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:49.363892 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:49.364328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:49.499090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:49.506975 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b4d9cb72-ad61-45fc-b7f0-ce5e52d64ad8 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.155044 Apr 26 14:15:49.507640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 332/669] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:49 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:49.662573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-276163267", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825254602", "security_groups": [{"name": "tempest-secgroup-smoke-445138182"}], "block_device_mapping_v2": [{"uuid": "81557b03-0db3-46ef-99c9-f53bb8ac52e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c46524c-1ef3-4576-ad52-5298a3962302"}]}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:49.769771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] validate_networks() for [('9c46524c-1ef3-4576-ad52-5298a3962302', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:15:50.171207 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:15:50.171626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:15:50.172123 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:15:50.172526 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:15:50.172928 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:15:50.181559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:50.182090 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:50.182891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:50.183320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:50.199652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:15:50.203694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for user 9cd225533a1e48a3a8f03339af74b851 and project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:15:50.259254 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:15:50.261355 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81557b03-0db3-46ef-99c9-f53bb8ac52e0',volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:15:50.525563 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:50.526206 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:50.532731 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:50.533261 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:50.534142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:50.534618 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:50.679833 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:50.687040 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d5038e59-7211-44e8-85ed-69d3da1abe8a tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1520 microversion: 2.1 time: 0.165547 Apr 26 14:15:50.687610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 333/670] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:50 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:50.696743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f3eaca97-3fba-4b74-adfb-97c1e313243d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.032038 Apr 26 14:15:50.696743 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 338/671] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:15:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:15:50.701251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ee611d25-7a40-4ba5-9704-a77bb08f76b5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:50.701901 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ee611d25-7a40-4ba5-9704-a77bb08f76b5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:50.758168 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ee611d25-7a40-4ba5-9704-a77bb08f76b5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:50.764839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ee611d25-7a40-4ba5-9704-a77bb08f76b5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1093 microversion: 2.1 time: 0.067472 Apr 26 14:15:50.765404 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 339/672] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:50 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:50.866736 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-47688660-5911-4803-b636-243c961d0367 req-036ba1cf-0657-469c-b188-029623969c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8", "name": "network-vif-deleted", "tag": "929beb4c-1416-4cbb-a27f-30e55ee70ab6"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:50.874516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-47688660-5911-4803-b636-243c961d0367 req-036ba1cf-0657-469c-b188-029623969c60 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:50.876326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-47688660-5911-4803-b636-243c961d0367 req-036ba1cf-0657-469c-b188-029623969c60 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:50.885910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-47688660-5911-4803-b636-243c961d0367 req-036ba1cf-0657-469c-b188-029623969c60 service nova] Creating event network-vif-deleted:929beb4c-1416-4cbb-a27f-30e55ee70ab6 for instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 on hv-cinder-83513 Apr 26 14:15:50.891027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-47688660-5911-4803-b636-243c961d0367 req-036ba1cf-0657-469c-b188-029623969c60 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027980 Apr 26 14:15:50.891619 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 334/673] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:51.704384 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:51.704993 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:51.711621 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:51.712013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:51.712795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:51.713233 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:51.743328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:51.743710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:51.744160 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lazy-loading 'fault' on Instance uuid 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:15:51.783012 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ce393383a460b9b5857f74224a1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afa3fcb59a274c22bcf1ebcf44211943', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:51.783565 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d800b891-f7d6-484f-a79c-40f6fa3cc58d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:51.784552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d800b891-f7d6-484f-a79c-40f6fa3cc58d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:51.791514 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9fcad005-9e33-402d-8db2-9cea98142833 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 200 len: 1311 microversion: 2.1 time: 0.091004 Apr 26 14:15:51.792611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 340/674] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:51 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 1311 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:51.836022 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d800b891-f7d6-484f-a79c-40f6fa3cc58d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:51.842535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d800b891-f7d6-484f-a79c-40f6fa3cc58d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1093 microversion: 2.1 time: 0.063703 Apr 26 14:15:51.843095 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 335/675] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:51 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:52.808503 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:52.809110 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] [instance: 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:52.815397 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:52.815847 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:52.816613 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:52.817048 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:52.830233 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] HTTP exception thrown: Instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 could not be found. Apr 26 14:15:52.830813 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] Returning 404 to user: Instance 6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:15:52.831645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f339a5e9-015c-4010-8a16-7f9f2ba668d6 tempest-ServerRescueNegativeTestJSON-1317579742 tempest-ServerRescueNegativeTestJSON-1317579742-project] 10.222.0.23 "GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8" status: 404 len: 111 microversion: 2.1 time: 0.027003 Apr 26 14:15:52.832738 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 341/676] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:52 2022] GET /compute/v2.1/servers/6ab6be25-c6b4-48be-8c6e-d90bdc07d6c8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:15:52.859764 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:52.860320 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:52.867680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:52.871967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:52.871967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:52.871967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:52.930131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:52.937654 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-86bb6578-0e1e-4357-94f2-739e3c4aab3d tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1191 microversion: 2.1 time: 0.082051 Apr 26 14:15:52.938252 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 336/677] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:52 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1191 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:53.957439 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:53.958371 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:53.967253 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:53.967715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:53.970437 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:53.971111 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:54.278122 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:54.286102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0c1a3329-5fc4-493d-a062-1e5b9e7ad104 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1276 microversion: 2.1 time: 0.332519 Apr 26 14:15:54.291102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 342/678] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:53 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1276 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:54.794946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-3b5acd0a-26b8-4bd6-aeb0-c8dedffad862 req-d6d8eb5f-0f99-40cc-a99a-dde1709bf576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4be11a3-72a9-4428-8e09-81d7f82eb3ac", "tag": "ea149bb2-7696-4711-8302-772e2f877a69"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:54.818613 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3b5acd0a-26b8-4bd6-aeb0-c8dedffad862 req-d6d8eb5f-0f99-40cc-a99a-dde1709bf576 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:54.819333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-3b5acd0a-26b8-4bd6-aeb0-c8dedffad862 req-d6d8eb5f-0f99-40cc-a99a-dde1709bf576 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:54.856938 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-3b5acd0a-26b8-4bd6-aeb0-c8dedffad862 req-d6d8eb5f-0f99-40cc-a99a-dde1709bf576 service nova] Creating event network-changed:ea149bb2-7696-4711-8302-772e2f877a69 for instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac on hv-cinder-83513 Apr 26 14:15:54.867953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-3b5acd0a-26b8-4bd6-aeb0-c8dedffad862 req-d6d8eb5f-0f99-40cc-a99a-dde1709bf576 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080481 Apr 26 14:15:54.873914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 337/679] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:15:55.306281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:55.308360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:55.316191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:55.317421 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:55.318649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:55.319303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:55.518649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:55.527113 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2b93953a-0c14-4f94-bac1-8a1007688003 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.227127 Apr 26 14:15:55.527907 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 343/680] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:55 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:56.545886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:56.546530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:56.553654 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:56.554572 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:56.555232 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:56.555670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:56.835352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:56.854493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f2ad4a63-d083-49a0-b954-f06e7a19f0c6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.312695 Apr 26 14:15:56.862427 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 338/681] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:56 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:57.879858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:57.879858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:57.885840 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:57.886452 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:57.887497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:57.888166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:57.903151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:57.904191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:57.911552 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:57.912278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:57.913247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:57.914138 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:57.952762 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-87413ff9-bca9-4645-a1db-738958249d01 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/ips" status: 200 len: 145 microversion: 2.1 time: 0.224391 Apr 26 14:15:57.953317 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 344/682] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:15:57 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/ips => generated 145 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:15:58.039449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:58.048189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6ab456a2-b5f0-4d00-8268-9a50e5a23877 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.177542 Apr 26 14:15:58.049280 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 339/683] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:57 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:15:59.066065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:15:59.067390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:59.073870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:59.074801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:59.075653 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:59.076161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:59.246652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:15:59.254065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5c3e31ea-20b4-41c7-a2d0-6375779bc664 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.192051 Apr 26 14:15:59.254632 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 345/684] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:15:59 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:15:59.513979 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c5263df-e623-428f-b6f5-27931c25b6e4"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:15:59.515111 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:15:59.521344 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:59.523994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:15:59.523994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:15:59.523994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:00.209456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ea810203-8c7e-4ecd-a918-3f4071aa29ba tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699106 Apr 26 14:16:00.210452 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 340/685] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:15:59 2022] POST /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:00.271438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:00.272643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:00.289735 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:00.290357 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:00.291201 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:00.291638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:00.446653 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:00.456352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-98229f6b-3270-465c-8815-a8bedd149f94 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.187487 Apr 26 14:16:00.457945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 346/686] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:00 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:01.478268 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:01.479522 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:01.486647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:01.487278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:01.488282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:01.488898 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:01.762300 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:01.770164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ba70f24f-d564-41ea-a417-7816ab3f7fbb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.298554 Apr 26 14:16:01.780059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 341/687] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:01 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:02.786719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:02.787321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:02.796304 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:02.796984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:02.798150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:02.802794 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:03.087522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:03.098714 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-62195bce-49eb-42d7-990e-baebd15fc9cf tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.315944 Apr 26 14:16:03.100431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 347/688] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:02 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:04.116427 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:04.117166 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:04.123858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:04.124642 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:04.125939 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:04.126998 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:04.294816 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:04.304044 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-eb46662c-2ae1-4235-b4b9-fa9a9206a866 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.192133 Apr 26 14:16:04.315891 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 342/689] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:04 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:04.606162 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6726b42e-fcec-49eb-bc92-5d78a3e759be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'create', calling method: .version_select at 0x7f4066bc98b0>, body: {"keypair": {"name": "tempest-keypair-1293126857"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:04.620520 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6726b42e-fcec-49eb-bc92-5d78a3e759be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:04.624595 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6726b42e-fcec-49eb-bc92-5d78a3e759be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for user 7bee532aeccf4bfe84c0e984651524dc and project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:04.947074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6726b42e-fcec-49eb-bc92-5d78a3e759be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:04.950685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-6726b42e-fcec-49eb-bc92-5d78a3e759be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for user 7bee532aeccf4bfe84c0e984651524dc and project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:04.969228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6726b42e-fcec-49eb-bc92-5d78a3e759be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.484397 Apr 26 14:16:04.969228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 348/690] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Apr 26 14:16:04 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 486 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 26 14:16:05.279496 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-cee4e69a-1697-4791-a5ca-c22b18e7c05f req-03d36489-e2b5-482b-9390-614635ab0d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4be11a3-72a9-4428-8e09-81d7f82eb3ac", "name": "network-vif-plugged", "status": "completed", "tag": "ea149bb2-7696-4711-8302-772e2f877a69"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:05.287445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-cee4e69a-1697-4791-a5ca-c22b18e7c05f req-03d36489-e2b5-482b-9390-614635ab0d52 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:05.287880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-cee4e69a-1697-4791-a5ca-c22b18e7c05f req-03d36489-e2b5-482b-9390-614635ab0d52 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:05.298691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-cee4e69a-1697-4791-a5ca-c22b18e7c05f req-03d36489-e2b5-482b-9390-614635ab0d52 service nova] Creating event network-vif-plugged:ea149bb2-7696-4711-8302-772e2f877a69 for instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac on hv-cinder-83513 Apr 26 14:16:05.303678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-cee4e69a-1697-4791-a5ca-c22b18e7c05f req-03d36489-e2b5-482b-9390-614635ab0d52 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092371 Apr 26 14:16:05.304490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 343/691] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:05.321747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:05.322617 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:05.329518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:05.330602 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:05.331439 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:05.332523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:05.473089 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:05.480768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-25af89dc-ee7e-428a-ae9c-3d635a60ff25 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.163390 Apr 26 14:16:05.481350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 349/692] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:05 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:06.500141 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:06.501613 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:06.510597 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:06.511407 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:06.512410 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:06.513103 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:06.672813 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:06.690567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-162af50a-4395-442d-b670-b05113fc77be tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.194792 Apr 26 14:16:06.700784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 344/693] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:06 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:07.224330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-877995318", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc63f20b-e52c-4941-838b-394d035812b6"}], "security_groups": [{"name": "tempest-securitygroup--1434921846"}], "key_name": "tempest-keypair-1293126857", "user_data": "}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:07.334905 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] validate_networks() for [('bc63f20b-e52c-4941-838b-394d035812b6', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:16:07.707387 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:07.708726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:07.715244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:07.715996 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:07.717052 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:07.717597 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:07.736908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:16:07.737327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:16:07.738041 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:16:07.738450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:16:07.738899 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:16:07.748962 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:07.752478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:07.752478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:07.752478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:07.770119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:07.774683 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for user 7bee532aeccf4bfe84c0e984651524dc and project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:07.786295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:16:07.788513 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:16:07.883941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:07.891678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b455d7a4-affd-48a9-96b8-dbf06bae6419 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1264 microversion: 2.1 time: 0.188368 Apr 26 14:16:07.892243 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 345/694] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:07 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:07.905138 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8895a8a1-1cd4-4018-8e15-83b9c0601e36 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.685944 Apr 26 14:16:07.911184 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 350/695] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Apr 26 14:16:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 26 14:16:07.918536 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c04cd313-7b08-4f33-8ed6-23be23bb2b51 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:07.923772 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c04cd313-7b08-4f33-8ed6-23be23bb2b51 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:07.997103 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c04cd313-7b08-4f33-8ed6-23be23bb2b51 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:08.004713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c04cd313-7b08-4f33-8ed6-23be23bb2b51 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:08.006860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c04cd313-7b08-4f33-8ed6-23be23bb2b51 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:08.007967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c04cd313-7b08-4f33-8ed6-23be23bb2b51 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1281 microversion: 2.20 time: 0.094980 Apr 26 14:16:08.008849 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 346/696] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:07 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:08.913101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:08.913101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:08.914253 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:08.914253 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:08.914676 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:08.914676 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:08.915054 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:08.915498 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:08.916564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:08.917015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:08.917877 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:08.918328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:08.945088 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-29b70ada-f847-499d-8b73-1d4e2fcc854c tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Apr 26 14:16:08.945669 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 351/697] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:08 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:08.955121 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:08.955622 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:08.961819 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:08.962241 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:08.963082 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:08.963519 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:08.996709 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1dd843f8-e813-44eb-b6d3-cd83f63a6a85 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/3c5263df-e623-428f-b6f5-27931c25b6e4" status: 200 len: 194 microversion: 2.1 time: 0.044629 Apr 26 14:16:08.997871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 352/698] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Apr 26 14:16:08 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/3c5263df-e623-428f-b6f5-27931c25b6e4 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:16:09.026677 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:09.027287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:09.034132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:09.034580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:09.035875 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:09.036305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:09.088744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:09.096240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c4a0e05d-dddb-493a-82f9-0fc43546a0da tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1451 microversion: 2.1 time: 0.190797 Apr 26 14:16:09.096993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 347/699] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:08 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1451 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:09.112589 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:09.114683 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:09.116783 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:09.121081 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:09.121526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:09.122510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:09.123146 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:09.126242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:09.127748 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:09.128913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8b5bb5b7-fa82-4f0b-9888-7b366fa3dc6b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1285 microversion: 2.20 time: 0.106184 Apr 26 14:16:09.129470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 353/700] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:09 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1285 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:09.269343 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:09.277184 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b41b8521-b5b0-4a50-bb24-d76adb2f14a0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1451 microversion: 2.1 time: 0.168176 Apr 26 14:16:09.277748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 348/701] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:09 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:09.491524 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:09.492004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:09.511908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:09.512376 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:09.513232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:09.513678 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:09.543506 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e9d2d8f1-baac-4646-91ee-8adcba23f0de tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/ips" status: 200 len: 150 microversion: 2.1 time: 0.056002 Apr 26 14:16:09.544075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 354/702] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:16:09 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/ips => generated 150 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:10.148100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:10.148763 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:10.155471 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:10.155738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:10.156581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:10.158278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:10.258793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:10.267317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:10.268804 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:10.269914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c2154528-5a0f-4bc9-a883-ff032b1ea8c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1341 microversion: 2.20 time: 0.126134 Apr 26 14:16:10.270497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 349/703] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:10 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1341 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:16:10.644901 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1d17bebd-39f4-4e90-ad1b-edb69ca2de75"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:10.646060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:10.652741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:10.653188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:10.653997 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:10.654424 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:11.245755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e48a353-acfb-4ac0-8d10-db186b686800"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:11.247272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:11.254753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:11.255210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:11.256784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:11.257265 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:11.548832 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7a96002e-7efc-4182-b346-13d743e47366 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "POST /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.908507 Apr 26 14:16:11.555075 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 355/704] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:16:10 2022] POST /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:11.562278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:11.562985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:11.576966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:11.577414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:11.578761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:11.579387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:11.672134 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:11.682512 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:11.682512 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:11.682863 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e1b27c4e-a285-4164-a469-83f80e6aa588 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1339 microversion: 2.20 time: 0.129889 Apr 26 14:16:11.683386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 356/705] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:11 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1339 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:11.991718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fc86d907-de50-4168-a936-6097f025b781 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750001 Apr 26 14:16:11.992335 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 350/706] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:16:11 2022] POST /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments => generated 194 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:12.701407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:12.702195 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:12.708486 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:12.709012 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:12.709890 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:12.710494 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:13.003315 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-c82f4d7e-8052-42c2-94ff-72f97e766aba req-40dee5ef-689e-4bba-a98b-595b6c6039f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4be11a3-72a9-4428-8e09-81d7f82eb3ac", "tag": "ea149bb2-7696-4711-8302-772e2f877a69"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:13.012630 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-c82f4d7e-8052-42c2-94ff-72f97e766aba req-40dee5ef-689e-4bba-a98b-595b6c6039f5 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:13.013456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-c82f4d7e-8052-42c2-94ff-72f97e766aba req-40dee5ef-689e-4bba-a98b-595b6c6039f5 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:13.026942 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-c82f4d7e-8052-42c2-94ff-72f97e766aba req-40dee5ef-689e-4bba-a98b-595b6c6039f5 service nova] Creating event network-changed:ea149bb2-7696-4711-8302-772e2f877a69 for instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac on hv-cinder-83513 Apr 26 14:16:13.033220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-c82f4d7e-8052-42c2-94ff-72f97e766aba req-40dee5ef-689e-4bba-a98b-595b6c6039f5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038801 Apr 26 14:16:13.034105 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 351/707] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:13.099356 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:13.111100 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:13.115393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:13.119347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e55d2792-8a6b-40a1-8b16-bb512fd5a083 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.421605 Apr 26 14:16:13.123758 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 357/708] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:12 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:14.145733 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:14.147282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:14.155479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:14.156131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:14.158617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:14.159318 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:14.382157 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:14.389988 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:14.391535 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:14.392620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-18c2e595-2854-479f-9eb9-2dab139dc700 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.254553 Apr 26 14:16:14.393175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 352/709] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:14 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:15.079003 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-5524cd2c-0a53-43dc-8fa5-bb05c74ee106 req-f2bf2cc7-c6d1-43d5-86d4-1c749f5e651a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:15.087317 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5524cd2c-0a53-43dc-8fa5-bb05c74ee106 req-f2bf2cc7-c6d1-43d5-86d4-1c749f5e651a service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:15.087880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5524cd2c-0a53-43dc-8fa5-bb05c74ee106 req-f2bf2cc7-c6d1-43d5-86d4-1c749f5e651a service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:15.099024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-5524cd2c-0a53-43dc-8fa5-bb05c74ee106 req-f2bf2cc7-c6d1-43d5-86d4-1c749f5e651a service nova] Creating event network-changed:cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac for instance 19eb5dea-2ee7-4a41-9058-de514304256b on hv-cinder-83513 Apr 26 14:16:15.103862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-5524cd2c-0a53-43dc-8fa5-bb05c74ee106 req-f2bf2cc7-c6d1-43d5-86d4-1c749f5e651a service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028527 Apr 26 14:16:15.104630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 358/710] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:16:15.412950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:15.414690 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:15.421692 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:15.424511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:15.425605 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:15.429326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:15.767067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:15.775116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:15.776656 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:15.777758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-773a2e98-6516-4a42-a7c5-5d1d3499b4d3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.370367 Apr 26 14:16:15.778356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 353/711] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:15 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:16.801753 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:16.804938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:16.817863 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:16.820137 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:16.845243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:16.845243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:17.044800 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:17.058014 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:17.060034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:17.061356 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5e45366e-01ba-46ff-ba2e-40c0c63bff3b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.267878 Apr 26 14:16:17.062497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 359/712] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:16 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:18.080872 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:18.082209 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:18.089369 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:18.089923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:18.090871 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:18.091395 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:18.523750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:18.544186 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:18.549437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:18.549437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7aeb874b-cac4-40d8-b503-6be18ac97b2a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.472798 Apr 26 14:16:18.558824 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 354/713] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:18 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:19.097265 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-daf64d1d-0b01-41b3-9eaf-320cb23a5bdd req-562852aa-1bbd-4bd1-bc0f-e5de4c6f3867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "name": "network-vif-plugged", "status": "completed", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:19.107967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-daf64d1d-0b01-41b3-9eaf-320cb23a5bdd req-562852aa-1bbd-4bd1-bc0f-e5de4c6f3867 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.108730 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-daf64d1d-0b01-41b3-9eaf-320cb23a5bdd req-562852aa-1bbd-4bd1-bc0f-e5de4c6f3867 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.127373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-daf64d1d-0b01-41b3-9eaf-320cb23a5bdd req-562852aa-1bbd-4bd1-bc0f-e5de4c6f3867 service nova] Creating event network-vif-plugged:cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac for instance 19eb5dea-2ee7-4a41-9058-de514304256b on hv-cinder-83513 Apr 26 14:16:19.132514 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-daf64d1d-0b01-41b3-9eaf-320cb23a5bdd req-562852aa-1bbd-4bd1-bc0f-e5de4c6f3867 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039905 Apr 26 14:16:19.135553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 360/714] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:19.150791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:19.152200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:19.158973 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.163168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.163168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.163168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.200543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-50707b2b-04dd-45c5-963c-bc4b91930c1b tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.054577 Apr 26 14:16:19.202103 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 355/715] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:19 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments => generated 371 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:19.357346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:19.357346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:19.358794 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.359344 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.360192 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.370386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.421662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b8117ff5-02ca-414f-be12-b5352e9dc11f tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/3c5263df-e623-428f-b6f5-27931c25b6e4" status: 200 len: 194 microversion: 2.1 time: 0.074985 Apr 26 14:16:19.422623 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 361/716] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Apr 26 14:16:19 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/3c5263df-e623-428f-b6f5-27931c25b6e4 => generated 194 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:19.432086 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:19.432914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:19.449621 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.450213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.451109 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.451645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.554141 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lazy-loading 'services' on Instance uuid fc3725be-7e4d-4cea-8ca3-65650da5c3a4 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:16:19.567969 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:19.568949 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:19.575986 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.576860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.578374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:19.579043 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:19.737071 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:19.744927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:19.746507 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:19.747604 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6be84a65-e9f1-4067-9301-82151452545d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.184376 Apr 26 14:16:19.748153 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 362/717] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:19 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:19.793870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-679055d9-1daf-4b6b-9ff0-97cd6ec48488 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/3c5263df-e623-428f-b6f5-27931c25b6e4" status: 202 len: 0 microversion: 2.1 time: 0.365655 Apr 26 14:16:19.794487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 356/718] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:16:19 2022] DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/3c5263df-e623-428f-b6f5-27931c25b6e4 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:16:20.766655 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:20.767813 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:20.776245 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:20.776916 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:20.777873 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:20.778340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:20.960572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:20.968698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:20.970710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:20.972032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d9e93a98-bd1c-4614-9a99-349e6df0a6fc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1407 microversion: 2.20 time: 0.209259 Apr 26 14:16:20.973078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 363/719] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:20 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:16:21.992490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:21.994368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:22.004420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:22.005079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:22.006359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:22.007007 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:22.299636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:22.308574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:22.310306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:22.311646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2e11f5e1-928c-46e6-b346-61f2a5b4bfcd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1598 microversion: 2.20 time: 0.324682 Apr 26 14:16:22.312263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 357/720] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:16:21 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1598 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:16:22.332943 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:22.333517 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:22.340034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:22.340674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:22.341643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:22.342130 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:22.438341 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bfecb9e7-2a2c-4adc-9c4b-f36adb84756a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.109293 Apr 26 14:16:22.447074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 364/721] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Apr 26 14:16:22 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:16:23.842663 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-73c8b0e1-bd98-4329-9e28-92e75a81bf14 req-fcac2c3d-4111-47a8-b8d2-18412f1feb34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:23.859070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-73c8b0e1-bd98-4329-9e28-92e75a81bf14 req-fcac2c3d-4111-47a8-b8d2-18412f1feb34 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:23.859611 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-73c8b0e1-bd98-4329-9e28-92e75a81bf14 req-fcac2c3d-4111-47a8-b8d2-18412f1feb34 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:23.872541 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-73c8b0e1-bd98-4329-9e28-92e75a81bf14 req-fcac2c3d-4111-47a8-b8d2-18412f1feb34 service nova] Creating event network-changed:cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac for instance 19eb5dea-2ee7-4a41-9058-de514304256b on hv-cinder-83513 Apr 26 14:16:23.879392 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-73c8b0e1-bd98-4329-9e28-92e75a81bf14 req-fcac2c3d-4111-47a8-b8d2-18412f1feb34 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040009 Apr 26 14:16:23.881327 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 358/722] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:26.092326 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7a501834-19a7-4c66-8bff-d6d373ee0db9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Action: 'create', calling method: .version_select at 0x7f406d3ba940>, body: {"keypair": {"name": "tempest-TestShelveInstance-476611449"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:26.112251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-7a501834-19a7-4c66-8bff-d6d373ee0db9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Getting quotas for project 51ea97fcafba4e8fbdd5c7004c94eafe. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:26.119275 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-7a501834-19a7-4c66-8bff-d6d373ee0db9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Getting quotas for user 688c6bd837bf4f1cbde64e64651ff745 and project 51ea97fcafba4e8fbdd5c7004c94eafe. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:26.155493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e48a353-acfb-4ac0-8d10-db186b686800"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:26.156749 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:26.168795 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:26.171735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:26.172582 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:26.173133 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:26.272973 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Invalid volume: volume 4e48a353-acfb-4ac0-8d10-db186b686800 is already attached to instances: 8b4e8add-c541-4ae3-9b22-5144661eee8d Apr 26 14:16:26.273790 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 400 to user: Invalid volume: volume 4e48a353-acfb-4ac0-8d10-db186b686800 is already attached to instances: 8b4e8add-c541-4ae3-9b22-5144661eee8d {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:26.275036 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ea31c045-8fb9-450a-888a-b2c5943871a9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123906 Apr 26 14:16:26.276289 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 359/723] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:16:26 2022] POST /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 26 14:16:26.353895 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:26.354497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:26.363199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:26.363737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:26.364622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:26.365154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:26.444086 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'services' on Instance uuid 8b4e8add-c541-4ae3-9b22-5144661eee8d {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:16:26.489451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-7a501834-19a7-4c66-8bff-d6d373ee0db9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Getting quotas for project 51ea97fcafba4e8fbdd5c7004c94eafe. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:26.493027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-7a501834-19a7-4c66-8bff-d6d373ee0db9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Getting quotas for user 688c6bd837bf4f1cbde64e64651ff745 and project 51ea97fcafba4e8fbdd5c7004c94eafe. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:26.506238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7a501834-19a7-4c66-8bff-d6d373ee0db9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.643643 Apr 26 14:16:26.506845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 365/724] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:16:25 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:26.627454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b4515875-5060-44ab-8153-34d6aa9c6b48 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments/4e48a353-acfb-4ac0-8d10-db186b686800" status: 202 len: 0 microversion: 2.1 time: 0.277688 Apr 26 14:16:26.628089 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 360/725] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:16:26 2022] DELETE /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments/4e48a353-acfb-4ac0-8d10-db186b686800 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:16:26.636914 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:26.638197 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:26.646006 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:26.646503 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:26.647278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:26.647742 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:26.679937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c0e429a7-9e74-41c2-9a93-8daee0279f69 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Apr 26 14:16:26.683719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 366/726] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:26 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:27.374169 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:27.374762 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:27.381602 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:27.382340 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:27.383129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:27.383586 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:27.422668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1771c7b4-3734-454e-bc08-935c134ca8dc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/1d17bebd-39f4-4e90-ad1b-edb69ca2de75" status: 200 len: 194 microversion: 2.1 time: 0.046679 Apr 26 14:16:27.422668 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 361/727] 10.222.0.23 () {58 vars in 1412 bytes} [Tue Apr 26 14:16:27 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/1d17bebd-39f4-4e90-ad1b-edb69ca2de75 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:27.426209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:27.426758 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:27.433029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:27.433481 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:27.434278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:27.434715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:27.520860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lazy-loading 'services' on Instance uuid fc3725be-7e4d-4cea-8ca3-65650da5c3a4 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:16:27.691902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:27.692881 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:27.698749 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:27.699199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:27.700195 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:27.700633 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:27.729158 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4702d602-491c-41fb-9a5b-41f736ade127 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041702 Apr 26 14:16:27.729720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 362/728] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:27 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:16:27.766287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f78864a2-5911-4232-a736-9f170914578e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/1d17bebd-39f4-4e90-ad1b-edb69ca2de75" status: 202 len: 0 microversion: 2.1 time: 0.344378 Apr 26 14:16:27.767181 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 367/729] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:16:27 2022] DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments/1d17bebd-39f4-4e90-ad1b-edb69ca2de75 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:16:28.741402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:28.742454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:28.754851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:28.755301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:28.756112 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:28.756541 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:28.794154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-504c7c8f-a9fa-4010-a7d3-fe948e42d86a tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056896 Apr 26 14:16:28.794717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 363/730] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:28 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:16:28.874671 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:28.875455 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:28.887127 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:28.890146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:28.903479 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:28.903479 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:28.968685 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:16:28.999121 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:29.000339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:29.017014 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.018542 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.019749 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.020425 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.070923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b2cf119f-1695-46d0-a95b-ea2debba615e tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075810 Apr 26 14:16:29.079375 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 364/731] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:28 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 26 14:16:29.212709 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:29.214190 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:29.220894 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.221532 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.223176 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.224227 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.270482 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7847cee8-ca12-434b-8db3-c31e049630a2 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062921 Apr 26 14:16:29.271134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 365/732] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:16:29 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 26 14:16:29.326360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8c182dcc-407f-4304-ba41-6985bd60e379 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 204 len: 0 microversion: 2.1 time: 0.445415 Apr 26 14:16:29.326360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 368/733] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:16:28 2022] DELETE /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:16:29.332098 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:29.332871 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:29.338758 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:29.339890 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:29.340832 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.341385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.342328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.342830 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.350515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.351410 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.352695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.353300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.384109 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:16:29.498594 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:29.507064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-812a6722-888a-4c27-a918-f92508302f02 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1682 microversion: 2.1 time: 0.178998 Apr 26 14:16:29.507631 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 366/734] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:29 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:29.661910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-0e8bca41-6a36-4233-a46c-5380d0ce6678 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 204 len: 0 microversion: 2.1 time: 0.330857 Apr 26 14:16:29.663080 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 369/735] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:16:29 2022] DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 26 14:16:29.671444 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:29.674183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:29.679566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.680009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.680788 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:29.681245 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:29.823216 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:29.834076 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8f74d303-1c5b-409e-9445-c4e8a63d59ce tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1672 microversion: 2.1 time: 0.166467 Apr 26 14:16:29.834812 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 367/736] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:29 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:30.525513 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:30.526275 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:30.533447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:30.534719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:30.535749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:30.536270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:30.669326 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:30.676826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e9af37fe-6da1-4c84-a3da-c9d05c12cc37 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1682 microversion: 2.1 time: 0.155596 Apr 26 14:16:30.677385 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 370/737] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:30 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:30.851072 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:30.851705 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:30.858116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:30.858563 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:30.859356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:30.859809 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:31.000576 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:31.010322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2eae791c-e841-4a4f-953f-d0eec3ec95cf tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1672 microversion: 2.1 time: 0.162956 Apr 26 14:16:31.010898 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 368/738] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:30 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:31.694868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:31.696148 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:31.702760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:31.703209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:31.704034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:31.704464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:32.031771 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:32.032351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:32.048967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:32.049420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:32.050242 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:32.050672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:32.072167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:32.080259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c45d695c-e3ce-4b0d-bce4-e83d5359ce6f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1682 microversion: 2.1 time: 0.389526 Apr 26 14:16:32.080830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 371/739] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:31 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1682 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:32.207716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:32.215169 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2be79d42-74a5-48cc-b3b8-933af703f2d6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1672 microversion: 2.1 time: 0.187346 Apr 26 14:16:32.215737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 369/740] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:32 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1672 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:32.817549 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-fcca40d4-d9e0-44e4-8619-b6ad636ceb1e req-fdaf2038-f4f3-4e89-b711-c047131800e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b4e8add-c541-4ae3-9b22-5144661eee8d", "name": "network-vif-deleted", "tag": "34dce262-591f-43ff-9324-4aa5369a0a47"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:32.827107 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fcca40d4-d9e0-44e4-8619-b6ad636ceb1e req-fdaf2038-f4f3-4e89-b711-c047131800e3 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:32.827797 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-fcca40d4-d9e0-44e4-8619-b6ad636ceb1e req-fdaf2038-f4f3-4e89-b711-c047131800e3 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:32.839658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-fcca40d4-d9e0-44e4-8619-b6ad636ceb1e req-fdaf2038-f4f3-4e89-b711-c047131800e3 service nova] Creating event network-vif-deleted:34dce262-591f-43ff-9324-4aa5369a0a47 for instance 8b4e8add-c541-4ae3-9b22-5144661eee8d on hv-cinder-83513 Apr 26 14:16:32.844994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-fcca40d4-d9e0-44e4-8619-b6ad636ceb1e req-fdaf2038-f4f3-4e89-b711-c047131800e3 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032567 Apr 26 14:16:32.845469 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 372/741] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:33.099414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:33.100111 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:33.111558 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:33.112159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:33.113153 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:33.115013 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:33.160373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:33.160921 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:33.161431 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'fault' on Instance uuid 8b4e8add-c541-4ae3-9b22-5144661eee8d {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:16:33.212041 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:33.221330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6588604d-9b35-42dc-aa5a-a645b3c931b9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 200 len: 1332 microversion: 2.1 time: 0.125952 Apr 26 14:16:33.233452 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 370/742] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:33 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 1332 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:33.234585 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:33.235426 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:33.247316 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:33.247936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:33.249037 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:33.249630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:33.332498 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5adf6fccb73242bab32c2fdf0ea23ff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f38bbf345384bdb9ed001c0965a3462', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:33.340804 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-df867d35-336e-4cfe-ba4d-6ec6c5bb4605 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 200 len: 1605 microversion: 2.1 time: 0.112305 Apr 26 14:16:33.351553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 373/743] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:33 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 1605 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:34.239699 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:34.240913 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:34.247532 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:34.248400 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:34.249190 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:34.250000 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:34.264804 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance 8b4e8add-c541-4ae3-9b22-5144661eee8d could not be found. Apr 26 14:16:34.265401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance 8b4e8add-c541-4ae3-9b22-5144661eee8d could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:34.266272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ce17132e-8897-426c-8705-2cedf8a4af5b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 404 len: 111 microversion: 2.1 time: 0.030794 Apr 26 14:16:34.266828 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 371/744] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:34 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:34.275746 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9325dc5e-21cb-4d35-9135-42eef4395899 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '.version_select at 0x7f4066bd3790>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:34.360584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9325dc5e-21cb-4d35-9135-42eef4395899 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604979815" status: 202 len: 0 microversion: 2.1 time: 0.088473 Apr 26 14:16:34.361909 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:34.362907 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 374/745] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Apr 26 14:16:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1604979815 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:16:34.363172 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:34.377742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:34.378488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:34.379530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:34.380139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:34.395402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] HTTP exception thrown: Instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 could not be found. Apr 26 14:16:34.396292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Returning 404 to user: Instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:34.397339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e2b67459-1a3b-4b8d-a37f-9625f97f7bc4 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 404 len: 111 microversion: 2.1 time: 0.041901 Apr 26 14:16:34.397884 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 372/746] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:34 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:16:34.406247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3d07d4d0-3f54-40d9-a705-59d8cc9bab88 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '.version_select at 0x7f4066bd0820>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:34.537921 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3d07d4d0-3f54-40d9-a705-59d8cc9bab88 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978868222" status: 202 len: 0 microversion: 2.1 time: 0.135508 Apr 26 14:16:34.538556 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 375/747] 10.222.0.23 () {58 vars in 1220 bytes} [Tue Apr 26 14:16:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1978868222 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:16:34.863473 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-27cc473d-eebc-4619-b887-5fd887c2e350 req-c385feb3-25f7-4221-b8d2-5f4140ee512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc3725be-7e4d-4cea-8ca3-65650da5c3a4", "name": "network-vif-deleted", "tag": "dd529bed-7d48-4697-bf08-d801037e368d"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:34.871281 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-27cc473d-eebc-4619-b887-5fd887c2e350 req-c385feb3-25f7-4221-b8d2-5f4140ee512d service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:34.871738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-27cc473d-eebc-4619-b887-5fd887c2e350 req-c385feb3-25f7-4221-b8d2-5f4140ee512d service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:34.897724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-27cc473d-eebc-4619-b887-5fd887c2e350 req-c385feb3-25f7-4221-b8d2-5f4140ee512d service nova] Creating event network-vif-deleted:dd529bed-7d48-4697-bf08-d801037e368d for instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 on hv-cinder-83513 Apr 26 14:16:34.897724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-27cc473d-eebc-4619-b887-5fd887c2e350 req-c385feb3-25f7-4221-b8d2-5f4140ee512d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036112 Apr 26 14:16:34.897724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 373/748] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:35.234979 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-30b92d5b-34d2-40f1-a494-00f2df39996b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: .version_select at 0x7f4066ba6ee0>, body: {"keypair": {"name": "tempest-keypair-782065258"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:35.252399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-30b92d5b-34d2-40f1-a494-00f2df39996b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:35.257023 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-30b92d5b-34d2-40f1-a494-00f2df39996b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:35.866844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-30b92d5b-34d2-40f1-a494-00f2df39996b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:35.870517 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-30b92d5b-34d2-40f1-a494-00f2df39996b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:35.883826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-30b92d5b-34d2-40f1-a494-00f2df39996b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.652706 Apr 26 14:16:35.884484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 376/749] 10.222.0.23 () {60 vars in 1157 bytes} [Tue Apr 26 14:16:35 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:38.078871 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:38.079462 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:38.085678 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:38.086172 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:38.087397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:38.087497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:38.100614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] HTTP exception thrown: Instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 could not be found. Apr 26 14:16:38.101112 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Returning 404 to user: Instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:38.101937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-70ab5af0-6280-4a49-b864-9a75b95377fc tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 404 len: 111 microversion: 2.1 time: 0.027813 Apr 26 14:16:38.102499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 374/750] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:16:38 2022] DELETE /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:38.111026 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:38.111638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: fc3725be-7e4d-4cea-8ca3-65650da5c3a4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:38.118104 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:38.118567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:38.119334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:38.119771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:38.133433 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] HTTP exception thrown: Instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 could not be found. Apr 26 14:16:38.134063 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Returning 404 to user: Instance fc3725be-7e4d-4cea-8ca3-65650da5c3a4 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:38.134885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3d5c5089-90ff-4903-a951-d15ecbe4aef5 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4" status: 404 len: 111 microversion: 2.1 time: 0.028189 Apr 26 14:16:38.135414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 377/751] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:38 2022] GET /compute/v2.1/servers/fc3725be-7e4d-4cea-8ca3-65650da5c3a4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:38.170548 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2124769979", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "db62da73-59c6-4f6f-98fa-3d9fee96e03d"}], "security_groups": [{"name": "tempest-securitygroup--1153179009"}], "key_name": "tempest-keypair-782065258", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:38.269080 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] validate_networks() for [('db62da73-59c6-4f6f-98fa-3d9fee96e03d', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:16:38.736191 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:16:38.736635 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:16:38.737113 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:16:38.737517 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:16:38.737926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:16:38.746459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:38.746902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:38.747695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:38.753315 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:38.764342 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:38.768758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Getting quotas for user 797d50f3ba6244f4a62b3abfa24410d9 and project 852d3fc9b96d4019912cc7b5d7e2db73. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:38.779486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:16:38.781768 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:16:38.875600 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8f529296-f573-40b6-8c66-6bb216f4ff05 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.709318 Apr 26 14:16:38.876269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 375/752] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:16:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:16:38.886340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-538aa5ec-4b7c-4b1b-9caf-11c88fda7a1f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:38.887013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-538aa5ec-4b7c-4b1b-9caf-11c88fda7a1f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:38.943322 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-538aa5ec-4b7c-4b1b-9caf-11c88fda7a1f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:38.950097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-538aa5ec-4b7c-4b1b-9caf-11c88fda7a1f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1241 microversion: 2.1 time: 0.067465 Apr 26 14:16:38.950644 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 378/753] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:38 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:39.390056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:39.390722 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:39.398014 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:39.398552 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:39.399329 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:39.399763 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:39.413670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] HTTP exception thrown: Instance feac5dcc-29a9-415d-9898-564338c394d0 could not be found. Apr 26 14:16:39.414578 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Returning 404 to user: Instance feac5dcc-29a9-415d-9898-564338c394d0 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:39.415401 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7a131f69-9444-46a9-a4ae-cf31d5a2a1f6 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "DELETE /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 404 len: 111 microversion: 2.1 time: 0.029797 Apr 26 14:16:39.415941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 376/754] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:16:39 2022] DELETE /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:39.424155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:39.424846 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] [instance: feac5dcc-29a9-415d-9898-564338c394d0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:39.439870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:39.439870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:39.439870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:39.439870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:39.452179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] HTTP exception thrown: Instance feac5dcc-29a9-415d-9898-564338c394d0 could not be found. Apr 26 14:16:39.452780 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] Returning 404 to user: Instance feac5dcc-29a9-415d-9898-564338c394d0 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:39.453617 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4d078363-6ed2-4fa1-ac23-4ed9af0bcf14 tempest-AttachVolumeTestJSON-1790814075 tempest-AttachVolumeTestJSON-1790814075-project] 10.222.0.23 "GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0" status: 404 len: 111 microversion: 2.1 time: 0.033487 Apr 26 14:16:39.454227 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 379/755] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:39 2022] GET /compute/v2.1/servers/feac5dcc-29a9-415d-9898-564338c394d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:39.968057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:39.968757 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:39.974914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:39.976038 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:39.977018 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:39.977446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:40.044566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:40.053235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-89799344-aeba-42d0-b804-d5097ce879d0 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1237 microversion: 2.1 time: 0.089009 Apr 26 14:16:40.054200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 377/756] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:39 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1237 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:41.072969 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:41.073608 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:41.079891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:41.080337 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:41.081660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:41.082119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:41.195440 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:41.202769 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-15d42734-3e91-4a59-986c-6d4ea8aa5502 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1299 microversion: 2.1 time: 0.133702 Apr 26 14:16:41.203549 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 380/757] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:41 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:42.222764 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:42.225096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:42.232476 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:42.233204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:42.234351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:42.234948 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:42.522849 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:42.530433 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2b2b3eff-a686-4466-9737-f8f6685e498f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.313172 Apr 26 14:16:42.534386 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 378/758] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:42 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:43.117839 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-72143b6a-f683-430d-8f59-ca0b90fddc08 req-8f4e4642-3a40-4503-8951-dbffc8fc9008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934", "tag": "19203db7-29e0-4a11-901b-b2736f005d0f"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:43.129537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-72143b6a-f683-430d-8f59-ca0b90fddc08 req-8f4e4642-3a40-4503-8951-dbffc8fc9008 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:43.130776 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-72143b6a-f683-430d-8f59-ca0b90fddc08 req-8f4e4642-3a40-4503-8951-dbffc8fc9008 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:43.157416 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-72143b6a-f683-430d-8f59-ca0b90fddc08 req-8f4e4642-3a40-4503-8951-dbffc8fc9008 service nova] Creating event network-changed:19203db7-29e0-4a11-901b-b2736f005d0f for instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 on hv-cinder-83513 Apr 26 14:16:43.164291 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-72143b6a-f683-430d-8f59-ca0b90fddc08 req-8f4e4642-3a40-4503-8951-dbffc8fc9008 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049943 Apr 26 14:16:43.165181 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 381/759] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:43.548070 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:43.548727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:43.554976 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:43.555429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:43.556202 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:43.556643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:43.814078 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:43.822862 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1a2be54b-c098-4499-8091-8b3e635bd31d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.278631 Apr 26 14:16:43.833005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 379/760] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:43 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:44.841029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:44.845029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:44.849112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:44.849562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:44.850366 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:44.850805 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:44.997407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:45.005218 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ffc6d239-1942-4cd8-aea9-58419333fdbe tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.168930 Apr 26 14:16:45.006134 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 382/761] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:44 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:45.812975 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-485421055", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-476611449", "security_groups": [{"name": "tempest-secgroup-smoke-881693636"}], "networks": [{"uuid": "0dcd5ba3-49d4-4822-bfaf-5ec655477521"}], "block_device_mapping_v2": [{"uuid": "afc1661a-0c56-4c06-8eb8-5c2447aeb23e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:45.923579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] validate_networks() for [('0dcd5ba3-49d4-4822-bfaf-5ec655477521', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:16:46.077103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2b58c939-6a89-4555-b9cb-17d169b9420b tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Action: 'create', calling method: .version_select at 0x7f4066bf2940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-971920954"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:46.298632 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:16:46.299082 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:16:46.300036 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:16:46.300461 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:16:46.300862 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:16:46.309173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:46.309608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:46.310433 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:46.310863 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:46.326958 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Getting quotas for project 51ea97fcafba4e8fbdd5c7004c94eafe. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:16:46.330576 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Getting quotas for user 688c6bd837bf4f1cbde64e64651ff745 and project 51ea97fcafba4e8fbdd5c7004c94eafe. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:16:46.385287 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:16:46.387417 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afc1661a-0c56-4c06-8eb8-5c2447aeb23e',volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:16:46.655907 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2b58c939-6a89-4555-b9cb-17d169b9420b tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.690956 Apr 26 14:16:46.656560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 383/762] 10.222.0.23 () {60 vars in 1154 bytes} [Tue Apr 26 14:16:45 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 692 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 26 14:16:46.667940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:46.668554 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:46.676093 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:46.676803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:46.678136 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:46.678772 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:46.767543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5b56db17-2e9f-4fb4-ba17-c074f5ae0fde tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.958310 Apr 26 14:16:46.768479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 380/763] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:16:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:16:46.772762 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-984201b8-1a45-4aab-9910-470fd3b9cf3f tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066a58af0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:46.833515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:46.834113 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-984201b8-1a45-4aab-9910-470fd3b9cf3f tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 200 len: 344 microversion: 2.1 time: 0.064803 Apr 26 14:16:46.834682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 381/764] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:16:46 2022] GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:46.842096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bd4f4ba6-a8f8-4427-b9e3-5af8cb74755f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:46.843066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bd4f4ba6-a8f8-4427-b9e3-5af8cb74755f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:46.845200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1ef1ca23-1c2c-4ffd-82ef-7d1fdae5cb0e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.187615 Apr 26 14:16:46.848302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 384/765] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:46 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:46.914010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bd4f4ba6-a8f8-4427-b9e3-5af8cb74755f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:46.920888 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bd4f4ba6-a8f8-4427-b9e3-5af8cb74755f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1087 microversion: 2.1 time: 0.084891 Apr 26 14:16:46.936786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 382/766] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:46 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1087 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:47.847766 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fc7fad81-e96f-4feb-a2f7-da1ed8b650b7 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066bf2040>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:47.864712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:47.865344 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:47.871911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:47.872360 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:47.873124 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:47.873557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:47.894522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fc7fad81-e96f-4feb-a2f7-da1ed8b650b7 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 200 len: 345 microversion: 2.1 time: 0.049580 Apr 26 14:16:47.894522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 385/767] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:16:47 2022] GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 345 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:47.905132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-32ce8cac-c0ed-4278-b6ad-f94a1aca697e tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Action: 'create', calling method: .version_select at 0x7f4066bf5d30>, body: {"snapshot": {"volume_id": "5ce1dbde-2bca-4549-ad32-011a86f5521a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1282272513"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:48.016710 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:48.024770 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c9fcf70a-e7c9-40b2-b64a-e89770573a46 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.163901 Apr 26 14:16:48.025342 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 383/768] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:47 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:48.029858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:48.030503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:48.036096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:48.036540 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:48.037295 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:48.037719 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:48.096912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:48.104786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1fd16e02-0647-4852-85f1-cd511ea75513 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1137 microversion: 2.1 time: 0.078265 Apr 26 14:16:48.105355 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 384/769] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:48 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1137 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:48.394966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-32ce8cac-c0ed-4278-b6ad-f94a1aca697e tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.493428 Apr 26 14:16:48.395547 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 386/770] 10.222.0.23 () {60 vars in 1161 bytes} [Tue Apr 26 14:16:47 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:16:48.405398 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f16fc448-d7a3-4634-a5db-19df66bde794 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066a4da60>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:48.434643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f16fc448-d7a3-4634-a5db-19df66bde794 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 200 len: 287 microversion: 2.1 time: 0.032894 Apr 26 14:16:48.435449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 385/771] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:48 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:48.444861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-dddf2a1c-7fc1-45a8-96f8-12879760dad2 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066bf0280>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:48.474594 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-dddf2a1c-7fc1-45a8-96f8-12879760dad2 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033375 Apr 26 14:16:48.475146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 387/772] 10.222.0.23 () {58 vars in 1139 bytes} [Tue Apr 26 14:16:48 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:48.485035 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1f2585a6-f335-4db8-affb-961087d3448c tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066ae6430>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:48.516397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1f2585a6-f335-4db8-affb-961087d3448c tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 200 len: 287 microversion: 2.1 time: 0.035186 Apr 26 14:16:48.517051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 386/773] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:48 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:49.011994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-37679ec1-ae17-4f03-8911-e9476afacb18 req-afa2892e-76d6-4c87-8943-3014093c9b23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934", "name": "network-vif-plugged", "status": "completed", "tag": "19203db7-29e0-4a11-901b-b2736f005d0f"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:49.024950 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-37679ec1-ae17-4f03-8911-e9476afacb18 req-afa2892e-76d6-4c87-8943-3014093c9b23 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:49.025425 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-37679ec1-ae17-4f03-8911-e9476afacb18 req-afa2892e-76d6-4c87-8943-3014093c9b23 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:49.049533 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-37679ec1-ae17-4f03-8911-e9476afacb18 req-afa2892e-76d6-4c87-8943-3014093c9b23 service nova] Creating event network-vif-plugged:19203db7-29e0-4a11-901b-b2736f005d0f for instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 on hv-cinder-83513 Apr 26 14:16:49.059333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-37679ec1-ae17-4f03-8911-e9476afacb18 req-afa2892e-76d6-4c87-8943-3014093c9b23 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051682 Apr 26 14:16:49.061468 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 388/774] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:49.121161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:49.121864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:49.128691 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:49.129366 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:49.130179 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:49.130619 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:49.161200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:49.161810 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:49.168737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:49.169187 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:49.169945 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:49.170405 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:49.190577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:49.197865 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1948ad10-0c2d-4bbc-a91a-2a974b9729ac tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1193 microversion: 2.1 time: 0.080948 Apr 26 14:16:49.198460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 389/775] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:49 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:49.298633 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:49.306243 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3f9c3338-5df6-4034-b880-8248df46608e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.267979 Apr 26 14:16:49.306795 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 387/776] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:49 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:49.528601 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-eb019541-e35f-4c1d-b04b-9ffc0dde88b3 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066c023a0>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:49.558022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-eb019541-e35f-4c1d-b04b-9ffc0dde88b3 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 200 len: 287 microversion: 2.1 time: 0.033247 Apr 26 14:16:49.558583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 390/777] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:49 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:50.215011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:50.215617 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:50.221947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:50.222427 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:50.223189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:50.223621 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:50.284487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:50.291991 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e2df2ff3-f1f2-4715-85a8-71b18ca96d85 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1193 microversion: 2.1 time: 0.080852 Apr 26 14:16:50.292551 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 388/778] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:50 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1193 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:50.323807 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:50.324427 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:50.330951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:50.331409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:50.332173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:50.332612 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:50.460947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:50.468216 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4aa50421-6518-434f-85ed-01cfbbb36616 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.148618 Apr 26 14:16:50.468718 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 391/779] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:50 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:50.570160 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2b0443e0-1e8d-484f-ae6a-4b50b896365a tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066c01d30>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:50.598163 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2b0443e0-1e8d-484f-ae6a-4b50b896365a tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 200 len: 287 microversion: 2.1 time: 0.031757 Apr 26 14:16:50.598709 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 389/780] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:50 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:51.308742 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:51.309343 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:51.315333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:51.315786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:51.316553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:51.316986 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:51.406567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:51.416146 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-27d1e7b8-6f42-4a09-978c-838acbc53f48 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1193 microversion: 2.1 time: 0.111223 Apr 26 14:16:51.417320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 392/781] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:51 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1193 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:51.485246 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:51.488726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:51.492010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:51.492526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:51.493365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:51.493962 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:51.609635 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-197be9ab-f930-4776-8204-065d6121de1e tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066bf2310>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:51.653386 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-197be9ab-f930-4776-8204-065d6121de1e tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 200 len: 288 microversion: 2.1 time: 0.047454 Apr 26 14:16:51.653948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 393/782] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:51 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 288 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:16:51.658986 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:51.667029 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5cb6371f-ca7a-4539-b3e7-a7d223627be2 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f406d3ba160>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:51.671090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-eb4d5e18-0887-4b3c-882e-10f81ab202a6 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.190043 Apr 26 14:16:51.672399 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 390/783] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:51 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:51.765845 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5cb6371f-ca7a-4539-b3e7-a7d223627be2 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "DELETE /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 202 len: 0 microversion: 2.1 time: 0.103644 Apr 26 14:16:51.766660 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 394/784] 10.222.0.23 () {58 vars in 1253 bytes} [Tue Apr 26 14:16:51 2022] DELETE /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:16:51.775145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-75da0d25-de8c-47c5-b31f-0afed99060e4 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066b820d0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:51.804784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-75da0d25-de8c-47c5-b31f-0afed99060e4 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 200 len: 287 microversion: 2.1 time: 0.033319 Apr 26 14:16:51.805428 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 391/785] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:51 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:52.434568 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:52.435732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:52.447616 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:52.448066 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:52.448896 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:52.449278 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:52.689298 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:52.690516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:52.696757 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:52.698726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:52.698726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:52.698726 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:52.840138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:52.848199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6763278a-08d2-4433-98e2-34ea944cd646 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1367 microversion: 2.1 time: 0.163229 Apr 26 14:16:52.849587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 392/786] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:52 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:16:52.863199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a017cddc-fa6a-4eec-a700-dc48f3165490 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066ae6ee0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:52.889241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-a017cddc-fa6a-4eec-a700-dc48f3165490 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] HTTP exception thrown: Snapshot 3950d419-7016-46cf-88dc-9490378b92c9 could not be found. Apr 26 14:16:52.889843 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a017cddc-fa6a-4eec-a700-dc48f3165490 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Returning 404 to user: Snapshot 3950d419-7016-46cf-88dc-9490378b92c9 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:52.890702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a017cddc-fa6a-4eec-a700-dc48f3165490 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9" status: 404 len: 111 microversion: 2.1 time: 0.039719 Apr 26 14:16:52.891250 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 393/787] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:16:52 2022] GET /compute/v2.1/os-snapshots/3950d419-7016-46cf-88dc-9490378b92c9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:52.899199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8ef824d4-6613-4ca4-9930-7bc74c802cbc tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066a58af0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:52.984193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:52.992421 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5076a4f4-d8f2-435e-8f3f-8dc67523b964 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1270 microversion: 2.1 time: 0.563057 Apr 26 14:16:52.992992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 395/788] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:52 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1270 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:53.070753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8ef824d4-6613-4ca4-9930-7bc74c802cbc tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 202 len: 0 microversion: 2.1 time: 0.175069 Apr 26 14:16:53.071353 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 394/789] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:16:52 2022] DELETE /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:16:53.079801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-325e7d18-0028-4f25-b5b9-456c3f71e75f tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066bf29d0>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:53.124531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-325e7d18-0028-4f25-b5b9-456c3f71e75f tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 200 len: 344 microversion: 2.1 time: 0.048761 Apr 26 14:16:53.131064 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 396/790] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:16:53 2022] GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:53.515022 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-6a8a46fb-7dfd-4c0a-9229-bb9493b2348a req-39c8a9f0-6580-4cad-88a6-796d0cd87dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:53.520734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-6a8a46fb-7dfd-4c0a-9229-bb9493b2348a req-39c8a9f0-6580-4cad-88a6-796d0cd87dda service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:53.521179 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-6a8a46fb-7dfd-4c0a-9229-bb9493b2348a req-39c8a9f0-6580-4cad-88a6-796d0cd87dda service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:53.533025 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-6a8a46fb-7dfd-4c0a-9229-bb9493b2348a req-39c8a9f0-6580-4cad-88a6-796d0cd87dda service nova] Creating event network-changed:9fb27f6a-f71d-4cc9-b31d-afcd61b0c670 for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 on hv-cinder-83513 Apr 26 14:16:53.539257 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-6a8a46fb-7dfd-4c0a-9229-bb9493b2348a req-39c8a9f0-6580-4cad-88a6-796d0cd87dda service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029667 Apr 26 14:16:53.539922 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 395/791] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:53.866837 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:53.867473 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:53.873350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:53.874085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:53.874855 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:53.875286 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:54.011846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:54.012493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:54.019076 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:54.019528 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:54.020300 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:54.020743 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:54.080491 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:54.087896 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-46c59351-1f30-41bd-accb-c0bef549bbba tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1558 microversion: 2.1 time: 0.225539 Apr 26 14:16:54.088594 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 397/792] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:53 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:54.106145 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:54.107061 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:54.113926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:54.114615 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:54.115701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:54.116149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:54.179581 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:54.187100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3c30f429-41b1-4c04-9ce8-056008c3d099 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.179972 Apr 26 14:16:54.187679 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 396/793] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:54 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:54.200021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2484ab19-2357-41ee-af9d-a98fba3db8b7 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066be20d0>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:54.227530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-2484ab19-2357-41ee-af9d-a98fba3db8b7 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] HTTP exception thrown: Volume 5ce1dbde-2bca-4549-ad32-011a86f5521a could not be found. Apr 26 14:16:54.228127 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2484ab19-2357-41ee-af9d-a98fba3db8b7 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Returning 404 to user: Volume 5ce1dbde-2bca-4549-ad32-011a86f5521a could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:54.228956 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2484ab19-2357-41ee-af9d-a98fba3db8b7 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 404 len: 109 microversion: 2.1 time: 0.033137 Apr 26 14:16:54.229500 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 397/794] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:16:54 2022] GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:54.243243 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-87543e00-cf5c-4a31-bd69-2d5ce1aea810 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066b82280>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:54.259641 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-96b717f6-77c9-495b-bcde-bfc38e2e9fc2 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.158613 Apr 26 14:16:54.260238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 398/795] 10.222.0.23 () {58 vars in 1274 bytes} [Tue Apr 26 14:16:54 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-interface => generated 285 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:16:54.270741 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-87543e00-cf5c-4a31-bd69-2d5ce1aea810 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] HTTP exception thrown: Volume 5ce1dbde-2bca-4549-ad32-011a86f5521a could not be found. Apr 26 14:16:54.271371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-87543e00-cf5c-4a31-bd69-2d5ce1aea810 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Returning 404 to user: Volume 5ce1dbde-2bca-4549-ad32-011a86f5521a could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:54.272492 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-87543e00-cf5c-4a31-bd69-2d5ce1aea810 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "DELETE /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 404 len: 109 microversion: 2.1 time: 0.032939 Apr 26 14:16:54.273038 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 398/796] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:16:54 2022] DELETE /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:16:54.281328 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-35413f43-4984-4d11-b47c-aeedd0815455 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Calling method '.version_select at 0x7f4066bd3040>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:54.311104 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-35413f43-4984-4d11-b47c-aeedd0815455 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] HTTP exception thrown: Volume 5ce1dbde-2bca-4549-ad32-011a86f5521a could not be found. Apr 26 14:16:54.311712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-35413f43-4984-4d11-b47c-aeedd0815455 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] Returning 404 to user: Volume 5ce1dbde-2bca-4549-ad32-011a86f5521a could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:16:54.312729 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-35413f43-4984-4d11-b47c-aeedd0815455 tempest-VolumesSnapshotsTestJSON-1934969010 tempest-VolumesSnapshotsTestJSON-1934969010-project] 10.222.0.23 "GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a" status: 404 len: 109 microversion: 2.1 time: 0.035296 Apr 26 14:16:54.313269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 399/797] 10.222.0.23 () {58 vars in 1244 bytes} [Tue Apr 26 14:16:54 2022] GET /compute/v2.1/os-volumes/5ce1dbde-2bca-4549-ad32-011a86f5521a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:16:55.208219 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:55.209491 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:55.216130 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:55.223769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:55.223769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:55.223769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:55.482737 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:55.498323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-edfeeb3a-1b7c-4a06-a841-76b3e3093805 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.287338 Apr 26 14:16:55.498323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 399/798] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:55 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:55.502936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-24edf8dd-b35e-4833-8331-68402eb4c85c req-13612459-0860-4f42-b643-302e74b9a4d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934", "tag": "19203db7-29e0-4a11-901b-b2736f005d0f"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:16:55.512074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-24edf8dd-b35e-4833-8331-68402eb4c85c req-13612459-0860-4f42-b643-302e74b9a4d8 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:55.512613 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-24edf8dd-b35e-4833-8331-68402eb4c85c req-13612459-0860-4f42-b643-302e74b9a4d8 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:55.523242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-24edf8dd-b35e-4833-8331-68402eb4c85c req-13612459-0860-4f42-b643-302e74b9a4d8 service nova] Creating event network-changed:19203db7-29e0-4a11-901b-b2736f005d0f for instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 on hv-cinder-83513 Apr 26 14:16:55.528133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-24edf8dd-b35e-4833-8331-68402eb4c85c req-13612459-0860-4f42-b643-302e74b9a4d8 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029975 Apr 26 14:16:55.529011 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 400/799] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:16:56.512540 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:56.513171 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:56.520174 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:56.520806 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:56.521569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:56.522193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:56.669445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:56.681039 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5da3bf63-4310-46b5-8e6e-28bbda8ef0a9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.172268 Apr 26 14:16:56.681656 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 400/800] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:56 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:57.698951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:57.699690 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:57.705740 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:57.706228 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:57.707007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:57.707443 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:57.840618 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:57.848373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-170e8f35-cead-4b44-b4fd-4a7460105d1b tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.154093 Apr 26 14:16:57.848949 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 401/801] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:57 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:16:58.864693 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:16:58.865293 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:16:58.871832 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:58.872272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:58.873192 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:16:58.878905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:16:59.011286 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:16:59.019060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-34523439-bbc8-4d6c-87fa-bcf686444827 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.158185 Apr 26 14:16:59.019614 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 401/802] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:16:58 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:00.036707 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:00.037317 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:00.044177 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:00.044631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:00.045444 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:00.045882 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:00.178870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:00.186130 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-cc09899b-394f-4851-b0ab-38ff17d2fa76 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.153279 Apr 26 14:17:00.186701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 402/803] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:00 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:01.203152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:01.203733 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:01.209794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:01.214798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:01.214798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:01.214798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:01.347349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:01.354898 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c437330e-94b6-4cf9-98e3-b49633d3e8b7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.155574 Apr 26 14:17:01.362233 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 402/804] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:01 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:02.373447 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:02.374135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:02.380419 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:02.380871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:02.381639 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:02.382110 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:02.523176 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:02.530498 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e92ef9b9-b894-41b8-b381-a8d5c13621d6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.160780 Apr 26 14:17:02.533696 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 403/805] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:02 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:03.550691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:03.551418 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:03.557645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:03.558121 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:03.559087 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:03.559526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:03.697056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:03.704495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-00b604ba-f773-4d5b-9d4c-41d8bdb06dbf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.158784 Apr 26 14:17:03.705128 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 403/806] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:03 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:04.721319 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:04.721934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:04.728107 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:04.728563 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:04.729338 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:04.729787 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:04.861399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:04.868665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b4e1b44d-fa07-4e1d-b027-3911f38e21c9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.151793 Apr 26 14:17:04.869230 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 404/807] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:04 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:05.107597 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-67bdb067-b4ee-4d6f-b54f-4b4952b14487 req-17934948-1f93-47b6-ade1-1605cb575544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "name": "network-vif-plugged", "status": "completed", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:05.115833 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-67bdb067-b4ee-4d6f-b54f-4b4952b14487 req-17934948-1f93-47b6-ade1-1605cb575544 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:05.116298 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-67bdb067-b4ee-4d6f-b54f-4b4952b14487 req-17934948-1f93-47b6-ade1-1605cb575544 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:05.126960 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-67bdb067-b4ee-4d6f-b54f-4b4952b14487 req-17934948-1f93-47b6-ade1-1605cb575544 service nova] Creating event network-vif-plugged:9fb27f6a-f71d-4cc9-b31d-afcd61b0c670 for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 on hv-cinder-83513 Apr 26 14:17:05.131855 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-67bdb067-b4ee-4d6f-b54f-4b4952b14487 req-17934948-1f93-47b6-ade1-1605cb575544 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027897 Apr 26 14:17:05.132418 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 404/808] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:17:05.884535 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:05.885144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:05.891530 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:05.891984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:05.892745 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:05.893184 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:06.024317 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:06.031393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bd23e654-f38c-423c-aec4-16fef3d5681a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1258 microversion: 2.1 time: 0.150718 Apr 26 14:17:06.031948 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 405/809] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:05 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:07.049801 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:07.050518 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:07.056538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:07.056980 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:07.057735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:07.058323 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:07.191939 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:07.199282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-14c5443a-1e2e-4b25-b08f-7b67f35ebc9a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1442 microversion: 2.1 time: 0.154659 Apr 26 14:17:07.199842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 405/810] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:07 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:17:07.215028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:07.215661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:07.221905 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:07.222374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:07.223130 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:07.223558 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:07.356722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:07.364551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-40a8f457-9fa9-4f30-a2be-97bd556a5f4f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1442 microversion: 2.1 time: 0.153318 Apr 26 14:17:07.365134 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 406/811] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:07 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:17:09.069596 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:09.070143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:09.076325 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:09.076777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:09.077550 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:09.078001 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:09.102827 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6b096e16-5946-4acc-8af8-29ea9ed4be2f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/ips" status: 200 len: 151 microversion: 2.20 time: 0.037142 Apr 26 14:17:09.103403 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 406/812] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Apr 26 14:17:09 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 26 14:17:09.382789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-8699fc19-61e0-413c-891f-41da78564788 req-93bbfd5d-0bfd-44a0-9b7a-506136ef2a5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:09.391119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-8699fc19-61e0-413c-891f-41da78564788 req-93bbfd5d-0bfd-44a0-9b7a-506136ef2a5d service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:09.392776 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-8699fc19-61e0-413c-891f-41da78564788 req-93bbfd5d-0bfd-44a0-9b7a-506136ef2a5d service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:09.402983 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-8699fc19-61e0-413c-891f-41da78564788 req-93bbfd5d-0bfd-44a0-9b7a-506136ef2a5d service nova] Creating event network-changed:9fb27f6a-f71d-4cc9-b31d-afcd61b0c670 for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 on hv-cinder-83513 Apr 26 14:17:09.408603 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-8699fc19-61e0-413c-891f-41da78564788 req-93bbfd5d-0bfd-44a0-9b7a-506136ef2a5d service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028802 Apr 26 14:17:09.409184 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 407/813] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:17:11.383934 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:11.384478 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:11.390966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:11.391407 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:11.392753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:11.393188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:11.415065 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lazy-loading 'flavor' on Instance uuid 19eb5dea-2ee7-4a41-9058-de514304256b {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:17:11.906957 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9946f7f9-6dbe-48cf-a180-783250d579e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/action" status: 202 len: 0 microversion: 2.20 time: 0.526769 Apr 26 14:17:11.907815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 407/814] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Apr 26 14:17:11 2022] POST /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:17:11.920625 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:11.921252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:11.927853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:11.928304 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:11.929078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:11.929516 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:12.063750 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:12.071461 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:12.072935 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:12.074092 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-74ce7d7f-e50d-41f5-8ac9-c98903ac4ed9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.158549 Apr 26 14:17:12.074642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 408/815] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:11 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:13.093155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:13.093842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:13.100020 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:13.100463 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:13.101215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:13.101643 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:13.228920 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:13.237210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:13.238728 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:13.239897 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4b4c7509-ffb4-464d-a3c3-a50c02139db2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.151702 Apr 26 14:17:13.240445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 408/816] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:13 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:14.258040 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:14.258676 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:14.264987 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:14.265433 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:14.266224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:14.266662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:14.408021 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:14.416149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:14.417647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:14.418820 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-715a905d-afd1-4f35-8101-04eff9ce28ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.164677 Apr 26 14:17:14.419369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 409/817] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:14 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:15.437233 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:15.437833 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:15.445334 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:15.445334 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:15.446019 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:15.446449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:15.575652 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:15.583518 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:15.585001 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:15.586207 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-060ad674-4011-4cee-91aa-41fcf197e187 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.152818 Apr 26 14:17:15.586758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 409/818] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:15 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:16.604364 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:16.625832 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:16.625832 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:16.625832 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:16.625832 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:16.626378 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:16.748733 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:16.754270 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:16.755776 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:16.756921 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c53fd72c-a803-4bd4-8dee-f103f53adc2e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.156482 Apr 26 14:17:16.757470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 410/819] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:16 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:17.775199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:17.775761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:17.782262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:17.783305 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:17.784059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:17.784488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:17.918750 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:17.926341 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:17.928337 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:17.928939 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0a918030-9289-4b14-9165-87278fbb08c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.157930 Apr 26 14:17:17.929495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 410/820] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:17 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:18.947469 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:18.948078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:18.955032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:18.955482 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:18.956250 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:18.956687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:19.099027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:19.106738 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:19.108236 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:19.109380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ad16c8d8-88f6-45c2-a189-640b3a1eda4d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.165795 Apr 26 14:17:19.109941 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 411/821] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:18 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:20.128456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:20.129053 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:20.135423 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:20.135870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:20.136626 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:20.137058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:20.265189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:20.273391 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:20.274888 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:20.276027 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9a74509a-2a62-40d8-91e6-bd3edc918db4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.151460 Apr 26 14:17:20.276578 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 411/822] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:20 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:21.294315 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:21.294912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:21.301717 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:21.302189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:21.302973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:21.303398 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:21.432929 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:21.441284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:21.442874 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:21.444088 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-007d8995-332b-44af-a9ea-7530fc121f49 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.153630 Apr 26 14:17:21.444643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 412/823] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:21 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:22.462160 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:22.469018 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:22.469018 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:22.469330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:22.470117 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:22.470543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:22.603885 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:22.612232 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:22.613723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:22.614905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9121d0cf-a6de-40cf-a246-ac0c4f7de51f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.156706 Apr 26 14:17:22.615456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 412/824] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:22 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:23.633076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:23.633678 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:23.639881 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:23.640324 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:23.641079 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:23.641515 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:23.768456 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:23.776099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:23.777582 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:23.778744 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a2ca412f-4cc2-4d12-bc0c-8946302e5c47 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.149529 Apr 26 14:17:23.779369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 413/825] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:23 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:24.797184 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:24.797790 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:24.804259 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:24.804709 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:24.805468 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:24.805901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:24.936093 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:24.944065 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:24.945555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:24.946733 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-895b1952-51ce-4699-8c82-4a4aea6ec2e6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.153598 Apr 26 14:17:24.947297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 413/826] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:24 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:25.964763 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:25.965372 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:25.971771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:25.972218 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:25.972981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:25.973424 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:26.103897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:26.111949 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:26.113437 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:26.114602 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-eeef3acf-e0d6-425b-a5f4-062b3888c4f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.153938 Apr 26 14:17:26.115159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 414/827] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:25 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:27.132984 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:27.133629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:27.139967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:27.140416 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:27.141180 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:27.141615 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:27.273891 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:27.281622 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:27.283151 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:27.284314 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1dd686c7-1036-4487-9083-b601431ef355 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.155257 Apr 26 14:17:27.284875 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 414/828] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:27 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:28.302989 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:28.303533 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:28.309796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:28.310274 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:28.311043 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:28.311478 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:28.441838 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:28.450475 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:28.451985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:28.453145 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6bc90c7b-fe93-4c86-8fd2-4c1f65778ce1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.154085 Apr 26 14:17:28.453708 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 415/829] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:28 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:29.471426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:29.472031 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:29.478300 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:29.478747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:29.479503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:29.479933 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:29.609416 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:29.616999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:29.618647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:29.619787 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a7b0341f-73ba-4d50-9373-ff80a2dd81e9 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.152243 Apr 26 14:17:29.620341 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 415/830] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:29 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:30.637815 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:30.638457 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:30.644651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:30.645093 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:30.645864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:30.646299 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:30.780174 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:30.787900 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:30.789639 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:30.791303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2bb58b87-5566-4c6e-9cbe-2f4eb2e856a1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.157313 Apr 26 14:17:30.791858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 416/831] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:30 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:31.809333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:31.809985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:31.816284 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:31.816734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:31.817497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:31.817931 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:31.947348 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:31.955129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:31.956628 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:31.957793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bf2886ab-ec3d-40d8-b440-536d9f33ff25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.152834 Apr 26 14:17:31.958364 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 416/832] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:31 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:32.975649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:32.976248 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:32.983017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:32.983464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:32.984217 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:32.984646 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:33.113045 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:33.120661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:33.122237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:33.123359 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-916d1aca-f2c2-4436-ac7e-f406d143c4b2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1744 microversion: 2.20 time: 0.151617 Apr 26 14:17:33.123903 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 417/833] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:32 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:34.141274 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:34.141941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:34.148227 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:34.148681 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:34.149451 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:34.149887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:34.280688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:34.288316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:34.290105 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:34.291820 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c5673db8-7784-49fc-a62f-50e3d334db6a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1744 microversion: 2.20 time: 0.153910 Apr 26 14:17:34.292365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 417/834] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:34 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:35.324579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:35.324579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:35.325137 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:35.325389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:35.326170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:35.326644 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:35.478953 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:35.490668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:35.490668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:35.490668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4a285ae0-e423-4fc9-9487-8e8073822360 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.183642 Apr 26 14:17:35.502063 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 418/835] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:35 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:36.508862 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:36.510131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:36.516771 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:36.517262 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:36.518092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:36.518557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:36.669629 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:36.681438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:36.683721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:36.684897 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-42520f44-21d7-469b-9aa0-25b0108e2798 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.180222 Apr 26 14:17:36.685456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 418/836] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:36 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:37.249678 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-71f72389-5a8b-45cc-a4f2-14ade41d056c req-a8918e33-370f-42eb-b5eb-fdc23403feef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "name": "network-vif-plugged", "status": "completed", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:37.261922 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-71f72389-5a8b-45cc-a4f2-14ade41d056c req-a8918e33-370f-42eb-b5eb-fdc23403feef service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:37.262708 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-71f72389-5a8b-45cc-a4f2-14ade41d056c req-a8918e33-370f-42eb-b5eb-fdc23403feef service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:37.275481 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-71f72389-5a8b-45cc-a4f2-14ade41d056c req-a8918e33-370f-42eb-b5eb-fdc23403feef service nova] Creating event network-vif-plugged:cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac for instance 19eb5dea-2ee7-4a41-9058-de514304256b on hv-cinder-83513 Apr 26 14:17:37.281591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-71f72389-5a8b-45cc-a4f2-14ade41d056c req-a8918e33-370f-42eb-b5eb-fdc23403feef service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035816 Apr 26 14:17:37.282770 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 419/837] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:17:37.704741 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:37.705270 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:37.712059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:37.712508 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:37.713324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:37.714032 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:37.857677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:37.867143 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:37.868727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:37.870657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bc0549d2-e4eb-4ce7-a42f-d6be3a551e3e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.169753 Apr 26 14:17:37.871567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 419/838] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:37 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:38.890409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:38.891115 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:38.897681 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:38.898219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:38.899007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:38.899460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:39.032910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:39.040903 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:39.064445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:39.064445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-13a119d4-95bd-467e-9080-418be4844fbf tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.157642 Apr 26 14:17:39.064445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 420/839] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:38 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:40.080584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:40.081186 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:40.089694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:40.093324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:40.093324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:40.093324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:40.279408 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:40.291165 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:40.292666 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:40.293839 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-77310d83-fd34-47fc-81c8-5f0d435dc46f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.217103 Apr 26 14:17:40.294744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 420/840] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:40 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:41.312586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:41.313805 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:41.320469 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:41.321213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:41.322941 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:41.323722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:41.506771 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:41.515994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:41.517856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:41.520346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-56b37ea2-0590-4ad1-b72b-6a9831669877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.210999 Apr 26 14:17:41.521100 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 421/841] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:41 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:42.540368 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:42.541470 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:42.548277 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:42.548753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:42.549541 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:42.549926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:42.690263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:42.698596 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:42.700084 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:42.702842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-ac795221-1be8-4a65-a119-bc6df77277a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.165978 Apr 26 14:17:42.702842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 421/842] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:42 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:43.720009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:43.721223 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:43.733395 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:43.734157 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:43.735106 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:43.735695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:43.967661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:43.981667 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:43.986679 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:43.989493 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-738d5121-0c24-4866-992a-bfba31124983 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.272220 Apr 26 14:17:43.995823 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 422/843] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:43 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:45.008010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:45.008502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:45.016280 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:45.018409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:45.018409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:45.018409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:45.184936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:45.202406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:45.203958 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:45.205380 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9ca3a327-97b2-4160-ac9e-f23ba1c08f8e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.201427 Apr 26 14:17:45.205952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 422/844] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:45 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:46.224144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:46.225582 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:46.239886 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:46.240405 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:46.241373 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:46.241887 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:46.398662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:46.407941 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:46.409691 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:46.411082 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-57b10602-251b-43be-a614-696e36069e50 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.191090 Apr 26 14:17:46.422692 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 423/845] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:46 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:47.428720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:47.429345 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:47.435796 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:47.441929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:47.441929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:47.441929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:47.573165 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:47.582324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:47.583807 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:47.584955 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f4b2131e-96f5-4baf-b8b1-1ca7da50d98b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1739 microversion: 2.20 time: 0.160028 Apr 26 14:17:47.585507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 423/846] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:47 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:47.658650 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:47.659181 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:47.665778 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:47.666486 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:47.667940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:47.668389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:47.690599 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4108d499-25b0-47c2-ad9b-15ced5916a2b tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/ips" status: 200 len: 149 microversion: 2.1 time: 0.035674 Apr 26 14:17:47.691167 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 424/847] 10.222.0.23 () {58 vars in 1247 bytes} [Tue Apr 26 14:17:47 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:17:48.603952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:48.604584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:48.610989 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:48.611436 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:48.612189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:48.612660 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:48.744218 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:48.752126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:48.753609 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:48.754847 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f12e7920-a579-45c3-9a23-5cb167e9e4b3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1721 microversion: 2.20 time: 0.154957 Apr 26 14:17:48.755433 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 424/848] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:48 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:49.498247 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a343c914-277e-42ec-8fb0-9c7fbf89dc60"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:49.499313 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:49.505850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:49.506370 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:49.507138 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:49.507583 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:49.774220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:49.774910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:49.781434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:49.781950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:49.782935 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:49.783373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:49.924470 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:49.932510 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:49.934777 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:49.935949 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a431c8f4-b8e3-4416-ae33-16c46aae45d8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1721 microversion: 2.20 time: 0.165707 Apr 26 14:17:49.937235 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 425/849] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:49 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:17:50.153421 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-924bbeeb-f78a-49ec-9377-7da2f2133e3c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "POST /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.656695 Apr 26 14:17:50.158759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 425/850] 10.222.0.23 () {60 vars in 1322 bytes} [Tue Apr 26 14:17:49 2022] POST /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments => generated 194 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:17:50.953939 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:50.954798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:50.961409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:50.961870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:50.967784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:50.967784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:51.093459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:51.107555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:51.109056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:51.110346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4d7b3474-daa2-4e49-8b8d-d422069fd13a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1664 microversion: 2.20 time: 0.160272 Apr 26 14:17:51.110910 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 426/851] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:50 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:51.129370 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ea8cdf1-b4ef-4717-a01b-f0f813a8774f"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:51.131055 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:51.137350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:51.137949 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:51.138846 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:51.139438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:51.248554 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-126f74d0-1234-4a51-b7a5-fb63a9395aef req-930b3091-669b-439d-91dc-3c3ab38c88e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "name": "network-vif-unplugged", "status": "completed", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:51.256574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-126f74d0-1234-4a51-b7a5-fb63a9395aef req-930b3091-669b-439d-91dc-3c3ab38c88e2 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:51.257021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-126f74d0-1234-4a51-b7a5-fb63a9395aef req-930b3091-669b-439d-91dc-3c3ab38c88e2 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:51.273936 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.compute.server_external_events [req-126f74d0-1234-4a51-b7a5-fb63a9395aef req-930b3091-669b-439d-91dc-3c3ab38c88e2 service nova] Unable to find a host for instance 19eb5dea-2ee7-4a41-9058-de514304256b. Dropping event network-vif-unplugged {{(pid=117601) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 26 14:17:51.274837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-126f74d0-1234-4a51-b7a5-fb63a9395aef req-930b3091-669b-439d-91dc-3c3ab38c88e2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030107 Apr 26 14:17:51.275455 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 427/852] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 26 14:17:51.866650 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d20dcbac-1c38-41c2-aee7-ec900f2b369e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.742177 Apr 26 14:17:51.867300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 426/853] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Apr 26 14:17:51 2022] POST /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments => generated 188 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:17:51.978695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:17:51.979259 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:51.986016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:51.986469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:51.987239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:51.987672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:52.257698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c127b234-720d-43cc-acf6-f71ed7c2d21d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/action" status: 202 len: 0 microversion: 2.20 time: 0.282547 Apr 26 14:17:52.258541 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 428/854] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Apr 26 14:17:51 2022] POST /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:17:52.267259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:52.268055 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:52.274579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:52.275097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:52.275926 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:52.276380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:52.436269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:52.453574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:52.455750 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:52.457387 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d15cc734-b2ad-4715-a3ff-d4c7c5db9e0f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1750 microversion: 2.20 time: 0.194199 Apr 26 14:17:52.458068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 427/855] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:52 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1750 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:53.476391 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:53.480710 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:53.484194 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:53.484646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:53.485409 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:53.485837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:53.619281 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:53.627485 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:53.628977 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:53.630157 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1d67b188-d5b4-46f6-8fed-e8aa71abe494 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1750 microversion: 2.20 time: 0.157754 Apr 26 14:17:53.630721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 429/856] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:53 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:54.648101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:54.648750 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:54.655245 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:54.655722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:54.656495 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:54.656936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:54.788333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:54.797474 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:54.799076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:54.800235 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8ba668db-27bd-4306-9dfe-7941b790fa4c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1752 microversion: 2.20 time: 0.155942 Apr 26 14:17:54.800799 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 428/857] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:54 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:55.819459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:55.820072 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:55.826606 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:55.827254 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:55.827794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:55.828256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:55.962000 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:55.970563 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:55.972330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:55.973989 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9bea2ce0-1b36-417e-8eb0-3a7a50e713d2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1752 microversion: 2.20 time: 0.158594 Apr 26 14:17:55.974636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 430/858] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:55 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:56.992672 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:56.993290 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:57.000156 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:57.000550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:57.001320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:57.001758 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:57.137740 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:57.146511 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:57.148398 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:57.149820 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9b484a60-2de9-4ed1-a468-9b8264c18afd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1752 microversion: 2.20 time: 0.161015 Apr 26 14:17:57.150401 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 429/859] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:56 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:57.921413 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:57.921902 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:57.928077 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:57.928520 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:57.929273 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:57.929730 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:58.006446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'services' on Instance uuid b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:17:58.168321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:58.168933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:58.175238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:58.175687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:58.176462 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:58.176897 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:58.204178 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-6ce89cb0-4a59-4d8d-944b-0a2691e1eedc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments/a343c914-277e-42ec-8fb0-9c7fbf89dc60" status: 202 len: 0 microversion: 2.1 time: 0.286999 Apr 26 14:17:58.205328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 431/860] 10.222.0.23 () {58 vars in 1415 bytes} [Tue Apr 26 14:17:57 2022] DELETE /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments/a343c914-277e-42ec-8fb0-9c7fbf89dc60 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:17:58.214108 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:58.216193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:58.222851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:58.223349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:58.224145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:58.224753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:58.253890 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b4f65cb6-602d-4e3d-9bf5-c41097843283 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Apr 26 14:17:58.254472 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 432/861] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:17:58 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:17:58.314733 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:58.323467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:58.324968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:58.326854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-416bf745-c746-4a15-bf21-6275eabb9b7f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1752 microversion: 2.20 time: 0.162004 Apr 26 14:17:58.327550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 430/862] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:58 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:17:59.266248 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:59.267175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:59.273695 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.274155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.274946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.275376 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.304033 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-524eb7c5-4579-4209-a19a-cdc7b3f4a10d tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042555 Apr 26 14:17:59.304660 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 433/863] 10.222.0.23 () {58 vars in 1301 bytes} [Tue Apr 26 14:17:59 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 26 14:17:59.344575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:59.345231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:59.351440 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.352125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.353155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.353936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.364765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:59.364765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:59.370841 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.371411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.372359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.373762 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.412150 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:17:59.514264 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:59.523030 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:59.524638 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:59.525823 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-31503007-c344-4e73-8132-3fface062116 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.185121 Apr 26 14:17:59.526427 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 431/864] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:17:59 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:17:59.734508 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-91c9635b-631f-4b16-a5ea-f23fead492af tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 204 len: 0 microversion: 2.1 time: 0.375889 Apr 26 14:17:59.735379 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 434/865] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:17:59 2022] DELETE /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 26 14:17:59.743519 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:17:59.744622 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:17:59.750998 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.751453 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.752271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:17:59.752734 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:17:59.886002 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:17:59.893826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-02d7aa7f-ce63-48ec-98e9-926ac87ab0a7 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.154218 Apr 26 14:17:59.894459 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 432/866] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:17:59 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:00.546130 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:00.546746 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:00.553213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:00.553686 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:00.554485 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:00.554942 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:00.728609 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:00.742551 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:00.750067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:00.751738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b9387405-1803-4209-9ad0-f2e2181c43e2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.210490 Apr 26 14:18:00.752311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 435/867] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:00 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:00.913791 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:00.915613 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:00.925144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:00.925887 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:00.926721 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:00.927334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:01.079154 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:01.087824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6a8b7b81-b16f-40c9-9303-3ac2fc41d3d8 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.180433 Apr 26 14:18:01.089059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 433/868] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:00 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:01.770099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:01.770727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:01.777278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:01.777722 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:01.778555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:01.779486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:01.972365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:01.985775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:01.987742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:01.990031 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7e4ea5cd-c00a-4818-9508-bfc3e0b52c1e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.223760 Apr 26 14:18:01.990673 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 436/869] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:01 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:02.106698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:02.108644 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:02.115125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:02.116231 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:02.116765 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:02.117289 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:02.289362 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:02.298389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f33902df-9091-4c4c-a7f9-17ee490262c9 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.196109 Apr 26 14:18:02.299314 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 434/870] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:02 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:03.008446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:03.009057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:03.016751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:03.017200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:03.018039 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:03.018479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:03.180390 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:03.190931 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:03.192746 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:03.194059 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-929c4cf3-fa12-4c50-bc0b-e385e7c5eb5a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.189658 Apr 26 14:18:03.206399 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 437/871] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:03 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:03.317060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:03.318713 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:03.331532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:03.331992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:03.332934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:03.333400 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:03.645551 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:03.655920 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-17c2dfee-929b-4d63-8181-5b5e275e0a89 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.342738 Apr 26 14:18:03.657668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 435/872] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:03 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:18:04.213339 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:04.216213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:04.222405 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:04.223344 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:04.224347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:04.225015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:04.385333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:04.396463 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:04.398615 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:04.404708 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-45b2f8f9-7479-4b29-aed8-4ee12547b640 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.194876 Apr 26 14:18:04.411015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 438/873] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:04 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:04.680189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:04.680189 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:04.684720 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:04.686106 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:04.687059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:04.687651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:04.843330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:04.852002 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-21f161d2-2a98-47b4-bf3f-35742d08cded tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.181363 Apr 26 14:18:04.858017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 436/874] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:04 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:05.433034 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:05.434735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:05.443511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:05.444503 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:05.446214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:05.446717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:05.596500 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:05.610241 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:05.612126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:05.613670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4dff2716-57b9-4d8b-9d81-2b7b769bb974 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.189704 Apr 26 14:18:05.614469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 439/875] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:05 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:05.873994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:05.875178 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:05.886376 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:05.887009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:05.888070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:05.890319 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:06.069327 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:06.078046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f4ffde91-4656-452c-817c-e94352a6b7b4 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.211284 Apr 26 14:18:06.088939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 437/876] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:05 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:18:06.632831 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:06.634239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:06.641105 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:06.641550 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:06.642357 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:06.643071 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:06.786738 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:06.796332 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:06.798156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:06.799414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3fc09b16-c329-4059-a179-20bea0665b73 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.170903 Apr 26 14:18:06.811703 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 440/877] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:06 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:18:07.095687 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:07.096973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:07.103210 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:07.103686 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:07.104601 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:07.105052 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:07.255252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:07.263961 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1c648277-818d-43d1-af52-80ce5ec17445 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.172268 Apr 26 14:18:07.265305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 438/878] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:07 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:07.819260 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:07.819922 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:07.826835 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:07.827282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:07.828047 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:07.828480 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:07.972122 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:07.980357 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:07.982383 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:07.983534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1f5905d6-35d6-4c31-add2-c257836ab6a3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.168360 Apr 26 14:18:07.984085 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 441/879] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:07 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:08.282858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:08.283445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:08.292312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:08.293102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:08.295123 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:08.295913 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:08.431450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:08.438807 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-66241d33-971f-4610-be4e-36196a14a46c tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.160446 Apr 26 14:18:08.439361 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 439/880] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:08 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:09.003030 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:09.003664 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:09.010033 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:09.010432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:09.011212 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:09.011644 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:09.145391 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:09.153680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:09.155216 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:09.156429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-72e66976-fd08-489f-811d-9f58a3ac26c5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.157316 Apr 26 14:18:09.157221 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 442/881] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:08 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:09.456618 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:09.457311 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:09.463481 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:09.463929 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:09.464686 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:09.465115 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:09.724648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:09.732484 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a1924fad-77b2-425b-9bed-c2efd6bf4b39 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1681 microversion: 2.1 time: 0.279201 Apr 26 14:18:09.733042 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 440/882] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:09 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1681 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:10.175263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:10.175864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:10.182042 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:10.182494 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:10.183256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:10.183691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:10.277283 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-c81324bc-3322-4927-bb06-a2cd93900b92 req-a44578d5-56e4-4dbf-abd9-2a8d89e5ad11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934", "name": "network-vif-deleted", "tag": "19203db7-29e0-4a11-901b-b2736f005d0f"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:10.286861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-c81324bc-3322-4927-bb06-a2cd93900b92 req-a44578d5-56e4-4dbf-abd9-2a8d89e5ad11 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:10.287438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-c81324bc-3322-4927-bb06-a2cd93900b92 req-a44578d5-56e4-4dbf-abd9-2a8d89e5ad11 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:10.300915 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-c81324bc-3322-4927-bb06-a2cd93900b92 req-a44578d5-56e4-4dbf-abd9-2a8d89e5ad11 service nova] Creating event network-vif-deleted:19203db7-29e0-4a11-901b-b2736f005d0f for instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 on hv-cinder-83513 Apr 26 14:18:10.306520 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-c81324bc-3322-4927-bb06-a2cd93900b92 req-a44578d5-56e4-4dbf-abd9-2a8d89e5ad11 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037919 Apr 26 14:18:10.307215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 441/883] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:18:10.343008 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:10.352337 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:10.354683 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:10.355999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-05f8a034-0336-4201-8e24-c5647df34dff tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.184617 Apr 26 14:18:10.357201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 443/884] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:10 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:10.750093 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:10.750982 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:10.760586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:10.765257 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:10.766226 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:10.766631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:10.797923 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:10.798392 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:10.798833 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lazy-loading 'fault' on Instance uuid b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:18:10.840706 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '797d50f3ba6244f4a62b3abfa24410d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '852d3fc9b96d4019912cc7b5d7e2db73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:10.848462 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8473d02f-3f2f-4500-a924-28d17cdcc8fc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 200 len: 1331 microversion: 2.1 time: 0.103002 Apr 26 14:18:10.849019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 442/885] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:10 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:11.376608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:11.377418 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:11.383985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:11.384443 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:11.385260 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:11.385702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:11.526040 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:11.538173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:11.540243 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:11.541459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-029d6d30-2249-4ff5-9bd0-0b08f3f88818 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.169670 Apr 26 14:18:11.542231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 444/886] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:11 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:11.865902 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:11.866658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:11.873084 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:11.877610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:11.877610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:11.877610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:11.888719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 could not be found. Apr 26 14:18:11.889810 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:11.890663 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c596ef38-4ec0-4b2d-a214-c273aa5653ff tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 404 len: 111 microversion: 2.1 time: 0.028744 Apr 26 14:18:11.891187 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 443/887] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:11 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:11.899646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8951397b-4a3f-4c65-905f-5a4feb561035 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '.version_select at 0x7f4067687160>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:11.902896 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8951397b-4a3f-4c65-905f-5a4feb561035 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [12725f8f-655f-4b7c-be4c-56a9261a8091] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 26 14:18:12.559846 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:12.560454 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:12.566399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:12.566853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:12.567623 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:12.568063 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:12.707952 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:12.716077 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:12.717617 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:12.718790 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9d3fc65a-c7ae-4e5b-bed9-be3fe7b28244 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.162919 Apr 26 14:18:12.719324 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 444/888] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:12 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:18:12.910454 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO oslo.messaging._drivers.impl_rabbit [None req-8951397b-4a3f-4c65-905f-5a4feb561035 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [12725f8f-655f-4b7c-be4c-56a9261a8091] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60672. Apr 26 14:18:12.981009 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8951397b-4a3f-4c65-905f-5a4feb561035 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782065258" status: 202 len: 0 microversion: 2.1 time: 1.085025 Apr 26 14:18:12.981521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 445/889] 10.222.0.23 () {58 vars in 1217 bytes} [Tue Apr 26 14:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782065258 => generated 0 bytes in 1086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:18:13.385984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:13.386591 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:13.393574 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:13.394145 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:13.394927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:13.395374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:13.423652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:18:13.660194 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7211faf2-dc16-46e6-b298-95808037e9a2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 204 len: 0 microversion: 2.1 time: 0.277791 Apr 26 14:18:13.668244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 445/890] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:18:13 2022] DELETE /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:18:13.670689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:13.671499 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:13.678313 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:13.678770 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:13.679544 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:13.679985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:13.750569 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:13.751559 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:13.758874 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:13.759577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:13.760601 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:13.760976 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:13.843721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:13.852024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-325254ab-612a-44f9-8b37-d9a098f80570 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1576 microversion: 2.1 time: 0.186446 Apr 26 14:18:13.853271 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 446/891] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:13 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1576 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:13.997795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:14.006657 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:14.008173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:14.009403 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-08c2742e-b645-464c-b3e0-71a555b1b351 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.276043 Apr 26 14:18:14.009908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 446/892] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:13 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:14.868560 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:14.869174 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:14.876142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:14.876594 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:14.877367 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:14.877846 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:14.992729 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:14.993573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:15.002009 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:15.002581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:15.003445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:15.003977 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:15.017170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 could not be found. Apr 26 14:18:15.017770 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:15.017946 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:15.018622 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3aab5287-0b5e-4b22-a11b-9d0b6b4e9c06 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 404 len: 111 microversion: 2.1 time: 0.032063 Apr 26 14:18:15.019166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 447/893] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:18:14 2022] DELETE /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:18:15.026012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c1ecac26-40a1-41a2-bc3e-084d2f9ebbff tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1576 microversion: 2.1 time: 0.161226 Apr 26 14:18:15.026588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 447/894] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:14 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:15.027047 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:15.027733 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:15.031613 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:15.032220 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:15.033807 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:15.034407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:15.035192 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:15.035624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:15.038010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:15.038469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:15.039513 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:15.040128 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:15.051598 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 could not be found. Apr 26 14:18:15.052281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:15.053239 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4e35c89e-7fc2-454c-b7e1-a3a3da462b92 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934" status: 404 len: 111 microversion: 2.1 time: 0.029851 Apr 26 14:18:15.053895 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 448/895] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:15 2022] GET /compute/v2.1/servers/b57aa0cf-d5f2-47c8-8af9-e4c3f5b78934 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:18:15.179079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:15.188463 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:15.189983 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:15.191173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b45fae68-b619-4790-ae56-0ba21d677702 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.163325 Apr 26 14:18:15.191740 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 448/896] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:15 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:16.043457 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:16.044103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:16.050904 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.051394 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.052170 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.052615 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.210819 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:16.215423 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:16.221712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.222209 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.223011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.223447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.243796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:16.243796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-262c136c-1115-4a53-ade5-f824e14c2ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1576 microversion: 2.1 time: 0.203883 Apr 26 14:18:16.243796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 449/897] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:16 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:18:16.290407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:16.299187 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:16.307342 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.308074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.309066 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.313205 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.329266 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance 8b4e8add-c541-4ae3-9b22-5144661eee8d could not be found. Apr 26 14:18:16.330349 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance 8b4e8add-c541-4ae3-9b22-5144661eee8d could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:16.331455 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a5eeef90-ea50-476a-8ffa-9d33945be17e tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 404 len: 111 microversion: 2.1 time: 0.045569 Apr 26 14:18:16.332237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 450/898] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:18:16 2022] DELETE /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:16.340549 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:16.341172 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 8b4e8add-c541-4ae3-9b22-5144661eee8d] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:16.347268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.348041 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.348830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.349271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.363030 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance 8b4e8add-c541-4ae3-9b22-5144661eee8d could not be found. Apr 26 14:18:16.364023 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance 8b4e8add-c541-4ae3-9b22-5144661eee8d could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:16.365047 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-ec17bd7f-ba5d-42de-b785-d754eeeedc7f tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d" status: 404 len: 111 microversion: 2.1 time: 0.028610 Apr 26 14:18:16.366099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 451/899] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:16 2022] GET /compute/v2.1/servers/8b4e8add-c541-4ae3-9b22-5144661eee8d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:18:16.374007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:16.374500 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:16.380962 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.381352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.382177 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.382623 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.384497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:16.394182 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:16.396200 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:16.397579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a6d2e681-5a0b-4f2f-ad6a-b7cd534d5dbb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.191167 Apr 26 14:18:16.398244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 could not be found. Apr 26 14:18:16.398402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 449/900] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:16 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:18:16.399142 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:16.399977 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-542653eb-0985-40a8-9e6b-c52488f696dc tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 404 len: 111 microversion: 2.1 time: 0.029770 Apr 26 14:18:16.400510 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 452/901] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:18:16 2022] DELETE /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:16.408094 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:16.408905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: 7dcfc893-f654-43b1-9ff6-fdd104caa297] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:16.415126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.415568 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.416325 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.416753 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.430472 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 could not be found. Apr 26 14:18:16.431055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance 7dcfc893-f654-43b1-9ff6-fdd104caa297 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:16.431876 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f7799624-518f-44d9-8469-150920ffdd17 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297" status: 404 len: 111 microversion: 2.1 time: 0.027538 Apr 26 14:18:16.432415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 450/902] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:16 2022] GET /compute/v2.1/servers/7dcfc893-f654-43b1-9ff6-fdd104caa297 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 26 14:18:16.605110 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-e4adda6e-8c2a-43ab-861f-548588ac7eac req-d7156917-a9c8-41b4-b598-92474f351df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4be11a3-72a9-4428-8e09-81d7f82eb3ac", "name": "network-vif-deleted", "tag": "ea149bb2-7696-4711-8302-772e2f877a69"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:16.627940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-e4adda6e-8c2a-43ab-861f-548588ac7eac req-d7156917-a9c8-41b4-b598-92474f351df5 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:16.628389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-e4adda6e-8c2a-43ab-861f-548588ac7eac req-d7156917-a9c8-41b4-b598-92474f351df5 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:16.640382 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-e4adda6e-8c2a-43ab-861f-548588ac7eac req-d7156917-a9c8-41b4-b598-92474f351df5 service nova] Creating event network-vif-deleted:ea149bb2-7696-4711-8302-772e2f877a69 for instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac on hv-cinder-83513 Apr 26 14:18:16.646533 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-e4adda6e-8c2a-43ab-861f-548588ac7eac req-d7156917-a9c8-41b4-b598-92474f351df5 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045651 Apr 26 14:18:16.648119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 453/903] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:18:17.260336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:17.260952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:17.268022 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.268701 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.269459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.270102 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.301418 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.302260 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.302937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lazy-loading 'fault' on Instance uuid a4be11a3-72a9-4428-8e09-81d7f82eb3ac {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:18:17.348532 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:17.357934 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-811044ed-73a1-434f-bfc6-aaf822f0a073 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 200 len: 1229 microversion: 2.1 time: 0.100908 Apr 26 14:18:17.359269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 451/904] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:17 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:17.417747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:17.419112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:17.426532 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.426972 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.427752 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.428187 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.517058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-0ed6b857-8086-4669-9686-f0d5f66e901a req-4f954d20-9c0d-43fa-ac19-824d6134d783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "name": "network-vif-plugged", "status": "completed", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:17.525576 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-0ed6b857-8086-4669-9686-f0d5f66e901a req-4f954d20-9c0d-43fa-ac19-824d6134d783 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.526322 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-0ed6b857-8086-4669-9686-f0d5f66e901a req-4f954d20-9c0d-43fa-ac19-824d6134d783 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.541077 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-0ed6b857-8086-4669-9686-f0d5f66e901a req-4f954d20-9c0d-43fa-ac19-824d6134d783 service nova] Creating event network-vif-plugged:cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac for instance 19eb5dea-2ee7-4a41-9058-de514304256b on hv-cinder-83513 Apr 26 14:18:17.546985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-0ed6b857-8086-4669-9686-f0d5f66e901a req-4f954d20-9c0d-43fa-ac19-824d6134d783 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034827 Apr 26 14:18:17.553333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 452/905] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:18:17.582826 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:17.591610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:17.593195 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:17.594434 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-106321dc-f868-4ee6-bf12-fba32dc98b69 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.182236 Apr 26 14:18:17.594984 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 454/906] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:17 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:17.730144 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:17.730878 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:17.737365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.737876 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.738742 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.739185 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.752732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance df98b23b-b855-4fcd-ab58-771e1f55e22b could not be found. Apr 26 14:18:17.760098 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance df98b23b-b855-4fcd-ab58-771e1f55e22b could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:17.760098 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-45a42598-f6ba-44b3-9b73-735b8c3c7d43 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "DELETE /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 404 len: 111 microversion: 2.1 time: 0.028421 Apr 26 14:18:17.760098 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 453/907] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:18:17 2022] DELETE /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:17.767610 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:17.768222 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] [instance: df98b23b-b855-4fcd-ab58-771e1f55e22b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:17.774016 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.774460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.775236 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:17.775678 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:17.788580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] HTTP exception thrown: Instance df98b23b-b855-4fcd-ab58-771e1f55e22b could not be found. Apr 26 14:18:17.789438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] Returning 404 to user: Instance df98b23b-b855-4fcd-ab58-771e1f55e22b could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:17.790281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-be81446c-2f1f-421e-91fc-b1eb1076de67 tempest-AttachVolumeNegativeTest-312910353 tempest-AttachVolumeNegativeTest-312910353-project] 10.222.0.23 "GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b" status: 404 len: 111 microversion: 2.1 time: 0.027127 Apr 26 14:18:17.790815 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 455/908] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:17 2022] GET /compute/v2.1/servers/df98b23b-b855-4fcd-ab58-771e1f55e22b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:18.375110 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:18.375648 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:18.381826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:18.382309 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:18.383067 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:18.383498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:18.396758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] HTTP exception thrown: Instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac could not be found. Apr 26 14:18:18.397347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Returning 404 to user: Instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:18:18.398207 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3008037e-5b4b-4518-8f47-e793e5d7f3f0 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 404 len: 111 microversion: 2.1 time: 0.027296 Apr 26 14:18:18.398748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 454/909] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:18 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:18:18.498965 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1983300937", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825254602", "security_groups": [{"name": "tempest-secgroup-smoke-445138182"}], "block_device_mapping_v2": [{"uuid": "81557b03-0db3-46ef-99c9-f53bb8ac52e0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c46524c-1ef3-4576-ad52-5298a3962302"}]}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:18.606682 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] validate_networks() for [('9c46524c-1ef3-4576-ad52-5298a3962302', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:18:18.613135 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:18.613746 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:18.619548 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:18.619999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:18.620953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:18.621396 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:18.877577 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:18.895024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:18.897691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:18.899131 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1d2a23e7-d4f2-4f73-99ea-78ce3a49c172 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.290479 Apr 26 14:18:18.912148 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 455/910] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:18 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:18:19.006618 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:18:19.007156 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:18:19.007674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:18:19.008076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:18:19.008483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:18:19.017474 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:19.018147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:19.018946 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:19.019377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:19.037068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:18:19.041219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for user 9cd225533a1e48a3a8f03339af74b851 and project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:18:19.101936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:18:19.104212 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81557b03-0db3-46ef-99c9-f53bb8ac52e0',volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:18:19.638321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: ERROR oslo.messaging._drivers.impl_rabbit [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [2f234274-bce3-464d-8eef-10cd277ec421] AMQP server on 10.222.0.23:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 26 14:18:19.919173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:19.933531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:19.933531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:19.933531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:19.933531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:19.933918 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:20.365230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:20.373808 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:20.375570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:20.376727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a07bb8e7-05df-4809-acf5-9390c85ab829 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1808 microversion: 2.20 time: 0.461532 Apr 26 14:18:20.377287 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 456/911] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:19 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1808 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:18:20.646853 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO oslo.messaging._drivers.impl_rabbit [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [2f234274-bce3-464d-8eef-10cd277ec421] Reconnected to AMQP server on 10.222.0.23:5672 via [amqp] client with port 60822. Apr 26 14:18:20.651562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-810af0b5-d954-489b-ada8-b89c177493d2 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.156535 Apr 26 14:18:20.652345 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 456/912] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:18:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 2158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:18:20.663119 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-62c7942c-15ef-4e0c-bb2a-9db508783c47 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:20.664917 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-62c7942c-15ef-4e0c-bb2a-9db508783c47 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:20.811115 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-62c7942c-15ef-4e0c-bb2a-9db508783c47 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:20.826440 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-62c7942c-15ef-4e0c-bb2a-9db508783c47 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1094 microversion: 2.1 time: 0.167495 Apr 26 14:18:20.827300 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 457/913] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:20 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1094 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:21.395928 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:21.396539 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:21.403742 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:21.404198 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:21.404976 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:21.405413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:21.654614 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:21.667692 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:21.669213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:21.670471 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7b56fb04-09b5-429e-9752-7edbbfc10a19 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1795 microversion: 2.20 time: 0.278578 Apr 26 14:18:21.671020 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 457/914] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:21 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1795 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:21.843684 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:21.844430 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:21.851242 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:21.851931 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:21.852821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:21.853346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:21.914728 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:21.922575 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-744a7030-d05e-4364-8430-84ec8eea0969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1144 microversion: 2.1 time: 0.082902 Apr 26 14:18:21.933912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 458/915] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:21 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:22.939224 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:22.939850 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:22.949444 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:22.959603 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:22.960727 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:22.961163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:23.067788 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:23.075732 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e7fb1f0f-53e0-4a4c-b32b-52a2533772eb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1210 microversion: 2.1 time: 0.141153 Apr 26 14:18:23.076590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 458/916] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:22 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:24.094050 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:24.094791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:24.100802 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:24.101252 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:24.102054 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:24.102494 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:24.237023 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:24.244287 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-986c03d5-b424-4af6-8145-520c19c8ac2b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1277 microversion: 2.1 time: 0.154327 Apr 26 14:18:24.244858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 459/917] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:24 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:25.261194 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:25.261774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:25.268735 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:25.269147 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:25.271918 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:25.271918 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:25.401460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:25.408809 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-24e98400-8cea-431a-a7ba-8816fcb726bb tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1277 microversion: 2.1 time: 0.151525 Apr 26 14:18:25.409378 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 459/918] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:25 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:26.426154 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:26.426775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:26.432975 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-6c3ab683-ee7f-4faa-831f-905c1dfd924d req-eed333a2-3f7b-4577-891a-d384a2bb6e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4237844-3d33-4a71-82aa-c4546b5cab6c", "tag": "7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:26.438793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:26.439527 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:26.440547 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:26.441620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:26.459092 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-6c3ab683-ee7f-4faa-831f-905c1dfd924d req-eed333a2-3f7b-4577-891a-d384a2bb6e7e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:26.459092 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-6c3ab683-ee7f-4faa-831f-905c1dfd924d req-eed333a2-3f7b-4577-891a-d384a2bb6e7e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:26.476350 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-6c3ab683-ee7f-4faa-831f-905c1dfd924d req-eed333a2-3f7b-4577-891a-d384a2bb6e7e service nova] Creating event network-changed:7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1 for instance e4237844-3d33-4a71-82aa-c4546b5cab6c on hv-cinder-83513 Apr 26 14:18:26.481998 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-6c3ab683-ee7f-4faa-831f-905c1dfd924d req-eed333a2-3f7b-4577-891a-d384a2bb6e7e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053127 Apr 26 14:18:26.482983 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 460/919] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:18:26.726745 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:26.735282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c0b9f413-4fbf-4d94-925e-0fb1337516db tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1277 microversion: 2.1 time: 0.313215 Apr 26 14:18:26.736481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 460/920] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:26 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1277 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:27.752798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:27.753522 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:27.759666 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:27.760119 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:27.760878 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:27.761309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:27.908592 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:27.916693 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-12ad5777-9c9b-4ee1-99d2-8688649786b7 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1277 microversion: 2.1 time: 0.168613 Apr 26 14:18:27.917261 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 461/921] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:27 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:28.932683 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:28.933291 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:28.939893 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:28.940393 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:28.941199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:28.941632 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:29.078587 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:29.085925 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-077b5a27-8ad4-47f4-9a8c-c87661284368 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.157189 Apr 26 14:18:29.088657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 461/922] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:28 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:30.103661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:30.104402 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:30.111490 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:30.112014 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:30.112854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:30.113365 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:30.249488 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:30.257406 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-62bf9ed2-3492-4c46-ae28-3a5e1001776a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.157759 Apr 26 14:18:30.257960 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 462/923] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:30 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:31.273951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:31.274579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:31.280945 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:31.281394 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:31.282188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:31.282658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:31.418974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:31.426756 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c4e5ecb1-3fd5-42e8-8776-4a2020983ad9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.156609 Apr 26 14:18:31.427516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 462/924] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:31 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:32.445981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:32.446719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:32.453101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:32.454345 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:32.455193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:32.455769 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:32.600848 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:32.608299 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d225a86b-8a76-48b7-af58-292b98aafc79 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.168196 Apr 26 14:18:32.608864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 463/925] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:32 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:33.624901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:33.625519 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:33.631886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:33.632331 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:33.633089 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:33.633519 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:33.767571 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:33.774870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-25287ec8-29b1-4565-956e-a4b7fcff683b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.153757 Apr 26 14:18:33.775435 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 463/926] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:33 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:34.792503 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:34.793110 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:34.808284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:34.808284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:34.808284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:34.808284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:34.946651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:34.953945 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-77a39685-c1c0-4a3c-a58a-88462a31fb3a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.165509 Apr 26 14:18:34.954518 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 464/927] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:34 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:35.970970 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:35.971580 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:35.978079 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:35.978296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:35.979058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:35.979487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:36.114321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:36.121700 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-966c572e-dd84-4732-93a3-d066b9ec4135 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.154513 Apr 26 14:18:36.122291 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 464/928] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:35 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:37.139376 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:37.139990 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:37.146258 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:37.146709 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:37.147474 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:37.147912 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:37.279178 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:37.286626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fe26276b-2c7c-4fd4-b257-dfd10d444138 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.151099 Apr 26 14:18:37.287196 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 465/929] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:37 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:37.982702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-18882ed2-b8db-4668-9458-85b7aaab4a20 req-747e689a-06fd-4bc2-a997-b8a17d3d48a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4237844-3d33-4a71-82aa-c4546b5cab6c", "name": "network-vif-plugged", "status": "completed", "tag": "7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:37.991385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-18882ed2-b8db-4668-9458-85b7aaab4a20 req-747e689a-06fd-4bc2-a997-b8a17d3d48a1 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:37.991821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-18882ed2-b8db-4668-9458-85b7aaab4a20 req-747e689a-06fd-4bc2-a997-b8a17d3d48a1 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:38.002767 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-18882ed2-b8db-4668-9458-85b7aaab4a20 req-747e689a-06fd-4bc2-a997-b8a17d3d48a1 service nova] Creating event network-vif-plugged:7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1 for instance e4237844-3d33-4a71-82aa-c4546b5cab6c on hv-cinder-83513 Apr 26 14:18:38.007666 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-18882ed2-b8db-4668-9458-85b7aaab4a20 req-747e689a-06fd-4bc2-a997-b8a17d3d48a1 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028812 Apr 26 14:18:38.008243 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 465/930] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:18:38.305493 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:38.306252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:38.312128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:38.312652 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:38.313503 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:38.314223 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:38.464759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:38.472083 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5c3ea185-1b06-4226-9037-c4900d2efd1e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.171494 Apr 26 14:18:38.472651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 466/931] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:38 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:39.489755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:39.490504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:39.496656 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:39.497152 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:39.497923 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:39.498391 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:39.637913 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:39.645486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d5f0f382-d26d-4350-99b0-b09c3a597ede tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1265 microversion: 2.1 time: 0.160516 Apr 26 14:18:39.646644 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 466/932] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:39 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:40.664323 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:40.665309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:40.674086 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:40.674546 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:40.675735 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:40.676319 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:40.827128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:40.835940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7363d85f-c690-49cf-8229-4499747e4056 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1452 microversion: 2.1 time: 0.178132 Apr 26 14:18:40.836537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 467/933] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:40 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:40.852858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:40.855016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:40.860446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:40.861443 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:40.862247 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:40.862684 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:41.008665 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:41.017173 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1342fb6a-b518-439b-9fc7-a011d75f66f5 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1452 microversion: 2.1 time: 0.168090 Apr 26 14:18:41.018056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 467/934] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:18:40 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:43.164636 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-619be3d4-7069-434c-b926-91b7c1e0b435 req-d2caf460-8104-4726-a27d-4d3248603a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4237844-3d33-4a71-82aa-c4546b5cab6c", "tag": "7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:43.172919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-619be3d4-7069-434c-b926-91b7c1e0b435 req-d2caf460-8104-4726-a27d-4d3248603a9f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:43.174868 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-619be3d4-7069-434c-b926-91b7c1e0b435 req-d2caf460-8104-4726-a27d-4d3248603a9f service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:43.185034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-619be3d4-7069-434c-b926-91b7c1e0b435 req-d2caf460-8104-4726-a27d-4d3248603a9f service nova] Creating event network-changed:7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1 for instance e4237844-3d33-4a71-82aa-c4546b5cab6c on hv-cinder-83513 Apr 26 14:18:43.190470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-619be3d4-7069-434c-b926-91b7c1e0b435 req-d2caf460-8104-4726-a27d-4d3248603a9f service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159711 Apr 26 14:18:43.191469 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 468/935] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:18:54.744186 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:54.744712 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:54.750760 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:54.751206 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:54.751974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:54.752406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:54.779812 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-10596bcb-fecb-4019-9fa1-7ffafd7a7cb5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments/8ea8cdf1-b4ef-4717-a01b-f0f813a8774f" status: 200 len: 194 microversion: 2.20 time: 0.039537 Apr 26 14:18:54.780415 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 468/936] 10.222.0.23 () {60 vars in 1453 bytes} [Tue Apr 26 14:18:54 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments/8ea8cdf1-b4ef-4717-a01b-f0f813a8774f => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:18:54.847348 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:54.848133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:54.855420 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:54.855856 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:54.856684 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:54.857120 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:54.934589 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lazy-loading 'services' on Instance uuid 19eb5dea-2ee7-4a41-9058-de514304256b {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:18:55.191065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-02d3807f-4487-44bc-8450-fc7e8b95e690 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments/8ea8cdf1-b4ef-4717-a01b-f0f813a8774f" status: 202 len: 0 microversion: 2.20 time: 0.347685 Apr 26 14:18:55.191562 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 469/937] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Apr 26 14:18:54 2022] DELETE /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments/8ea8cdf1-b4ef-4717-a01b-f0f813a8774f => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:18:55.200060 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:55.201015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:55.208477 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:55.208922 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:55.209681 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:55.210138 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:55.241724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-903b8ade-c258-4f97-b755-8cfcda2b482f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045562 Apr 26 14:18:55.242540 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 469/938] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Apr 26 14:18:55 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:18:56.253833 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:56.254882 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:56.260900 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:56.261342 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:56.262211 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:56.262642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:56.291196 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-17c5181a-706a-4256-ad4e-8ba1be9ba9be tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042082 Apr 26 14:18:56.291760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 470/939] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Apr 26 14:18:56 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:18:56.349321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:56.350313 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:56.357356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:56.357904 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:56.358732 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:56.359181 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:56.385538 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:18:56.688728 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-21949611-2fe6-452e-8bee-06de76160a22 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 204 len: 0 microversion: 2.20 time: 0.343990 Apr 26 14:18:56.689327 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 470/940] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Apr 26 14:18:56 2022] DELETE /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 26 14:18:56.697409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:56.698183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:56.704000 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:56.704454 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:56.705217 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:56.705661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:56.845085 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:56.853761 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:56.855252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:56.856430 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5c437834-d7be-4222-bd4c-886871d27769 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.162935 Apr 26 14:18:56.856978 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 471/941] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:56 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:57.875747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:57.876553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:57.884092 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:57.888051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:57.888051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:57.888051 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:58.020911 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:58.028588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:58.030091 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:58.031238 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bdb78656-0b8b-44b8-973d-16493cba799a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.159923 Apr 26 14:18:58.031787 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 471/942] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:57 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:59.051321 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:18:59.052451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:18:59.058774 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:59.059335 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:59.060101 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:59.060537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:59.297531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:59.305849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:59.307375 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:18:59.308531 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b1cdfd30-54c9-4730-bfc2-54e6c74523f1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 200 len: 1723 microversion: 2.20 time: 0.262009 Apr 26 14:18:59.309133 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 472/943] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:18:59 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:18:59.508447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-ccb6b221-31ec-4059-9b08-d83927e81e68 req-f5d3dd59-27d4-4bd9-bece-76c2611dbc50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19eb5dea-2ee7-4a41-9058-de514304256b", "name": "network-vif-deleted", "tag": "cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:18:59.516675 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-ccb6b221-31ec-4059-9b08-d83927e81e68 req-f5d3dd59-27d4-4bd9-bece-76c2611dbc50 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:18:59.517925 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-ccb6b221-31ec-4059-9b08-d83927e81e68 req-f5d3dd59-27d4-4bd9-bece-76c2611dbc50 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:18:59.528381 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-ccb6b221-31ec-4059-9b08-d83927e81e68 req-f5d3dd59-27d4-4bd9-bece-76c2611dbc50 service nova] Creating event network-vif-deleted:cbd4e808-d0c8-4cad-a0d4-f17de7b6eaac for instance 19eb5dea-2ee7-4a41-9058-de514304256b on hv-cinder-83513 Apr 26 14:18:59.533637 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-ccb6b221-31ec-4059-9b08-d83927e81e68 req-f5d3dd59-27d4-4bd9-bece-76c2611dbc50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029333 Apr 26 14:18:59.534270 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 472/944] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:19:00.327310 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:00.327934 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:00.335191 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:00.338280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:00.338280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:00.338280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:00.351528 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] HTTP exception thrown: Instance 19eb5dea-2ee7-4a41-9058-de514304256b could not be found. Apr 26 14:19:00.352128 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Returning 404 to user: Instance 19eb5dea-2ee7-4a41-9058-de514304256b could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:19:00.352973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3aa5c2a7-c927-4f5d-b4ad-72dbd5092a4f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 404 len: 111 microversion: 2.20 time: 0.029763 Apr 26 14:19:00.353521 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 473/945] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:00 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:19:00.362491 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b2fa61c8-7cb0-4928-8d65-283bde3b338a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '.version_select at 0x7f4066bcc160>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:00.449621 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b2fa61c8-7cb0-4928-8d65-283bde3b338a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293126857" status: 204 len: 0 microversion: 2.20 time: 0.091259 Apr 26 14:19:00.451268 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 473/946] 10.222.0.23 () {60 vars in 1261 bytes} [Tue Apr 26 14:19:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293126857 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 26 14:19:01.228797 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-186b7545-bbed-4c6a-aff7-3864d13fca33 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'create', calling method: .version_select at 0x7f4066c8d670>, body: {"keypair": {"name": "tempest-keypair-306742367"}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:01.243943 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-186b7545-bbed-4c6a-aff7-3864d13fca33 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:19:01.248046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-186b7545-bbed-4c6a-aff7-3864d13fca33 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for user 7bee532aeccf4bfe84c0e984651524dc and project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:19:01.396754 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-186b7545-bbed-4c6a-aff7-3864d13fca33 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:19:01.400590 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-186b7545-bbed-4c6a-aff7-3864d13fca33 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for user 7bee532aeccf4bfe84c0e984651524dc and project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'key_pairs'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:19:01.413589 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-186b7545-bbed-4c6a-aff7-3864d13fca33 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.190611 Apr 26 14:19:01.415046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 474/947] 10.222.0.23 () {62 vars in 1198 bytes} [Tue Apr 26 14:19:01 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 192 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Apr 26 14:19:03.892175 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1924821405", "imageRef": "84492c51-c8f1-4bde-9b16-d42b49024bdd", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc63f20b-e52c-4941-838b-394d035812b6"}], "security_groups": [{"name": "tempest-securitygroup--2135464847"}], "key_name": "tempest-keypair-306742367", "user_data": "}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:03.992550 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.network.neutron [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] validate_networks() for [('bc63f20b-e52c-4941-838b-394d035812b6', None, None, None, None, None)] {{(pid=117601) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:19:04.363159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Flavor limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:19:04.363159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Image limits 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:19:04.363159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Flavor pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:19:04.363159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Image pref 0:0:0 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:19:04.363549 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.virt.hardware [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117601) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:19:04.372062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:04.372509 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:04.373299 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:04.373734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:04.390174 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:19:04.394053 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.quota [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Getting quotas for user 7bee532aeccf4bfe84c0e984651524dc and project ceae37df7abe4226ab88abbc1d289a5c. Resources: {'cores', 'ram', 'instances'} {{(pid=117601) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:19:04.405434 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Going to run 1 instances... {{(pid=117601) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:19:04.407901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84492c51-c8f1-4bde-9b16-d42b49024bdd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117601) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:19:04.519393 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-dbc55db4-0156-4945-ad8f-63bdb218e2cd tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.631929 Apr 26 14:19:04.520204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 474/948] 10.222.0.23 () {62 vars in 1187 bytes} [Tue Apr 26 14:19:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 26 14:19:04.531060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e1aec5a7-d088-4cde-9516-615bb580322b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:04.531745 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e1aec5a7-d088-4cde-9516-615bb580322b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:04.583213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1aec5a7-d088-4cde-9516-615bb580322b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:04.590306 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1aec5a7-d088-4cde-9516-615bb580322b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:04.591864 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e1aec5a7-d088-4cde-9516-615bb580322b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:04.592966 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e1aec5a7-d088-4cde-9516-615bb580322b tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1281 microversion: 2.20 time: 0.066389 Apr 26 14:19:04.593516 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 475/949] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:04 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:05.611545 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:05.612184 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:05.619566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:05.620012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:05.620766 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:05.621195 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:05.681045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:05.688852 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:05.690365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:05.691445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-87f3e316-ca98-42a8-a3a2-8d532abc833d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1285 microversion: 2.20 time: 0.084280 Apr 26 14:19:05.692097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 475/950] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:05 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:06.709312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:06.709931 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:06.716200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:06.716657 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:06.717648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:06.718118 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:06.790737 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:06.799295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:06.800855 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:06.802534 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3d74b795-93a8-405f-ada7-6f225aca0c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1341 microversion: 2.20 time: 0.097690 Apr 26 14:19:06.803094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 476/951] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:06 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1341 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:07.820818 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:07.821996 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:07.828785 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:07.829303 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:07.830106 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:07.830724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:07.966906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:07.975361 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:07.976937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:07.978196 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-45136e24-4d4e-463b-9349-53b0c1b87efb tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.161475 Apr 26 14:19:07.978759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 476/952] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:07 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:08.447497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-5039c9c6-5ab1-44cb-b937-99ed1eba3587 req-e469fa07-2652-458a-971a-e68a0c4afb2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:08.458817 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5039c9c6-5ab1-44cb-b937-99ed1eba3587 req-e469fa07-2652-458a-971a-e68a0c4afb2e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:08.464507 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5039c9c6-5ab1-44cb-b937-99ed1eba3587 req-e469fa07-2652-458a-971a-e68a0c4afb2e service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:08.472323 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-5039c9c6-5ab1-44cb-b937-99ed1eba3587 req-e469fa07-2652-458a-971a-e68a0c4afb2e service nova] Creating event network-changed:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:19:08.477460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-5039c9c6-5ab1-44cb-b937-99ed1eba3587 req-e469fa07-2652-458a-971a-e68a0c4afb2e service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033983 Apr 26 14:19:08.478360 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 477/953] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:19:08.996345 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:08.997077 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:09.003347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:09.003791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:09.005137 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:09.005608 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:09.133419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:09.148521 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:09.150043 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:09.151636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-edbecef3-7c91-4a64-9aa6-92ac24598262 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.158679 Apr 26 14:19:09.152208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 477/954] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:08 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:10.170094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:10.170794 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:10.176956 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:10.177407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:10.178199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:10.178640 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:10.309844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:10.318008 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:10.319509 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:10.320607 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-1b3e8775-5552-45d5-a3d0-870803e92caa tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.155277 Apr 26 14:19:10.321165 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 478/955] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:10 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:11.338568 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:11.339207 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:11.345453 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:11.345900 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:11.346702 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:11.347139 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:11.485080 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:11.493497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:11.495026 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:11.496129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f71bc926-e040-4760-a3b2-a89472ddd2f8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.161471 Apr 26 14:19:11.496696 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 478/956] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:11 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:12.514209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:12.515451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:12.522313 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:12.522766 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:12.523770 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:12.524208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:12.655150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:12.662971 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:12.664738 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:12.665841 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-11532749-709d-407f-b9d2-30794f63a123 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.155656 Apr 26 14:19:12.666423 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 479/957] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:12 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:13.683755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:13.684365 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:13.690662 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:13.691112 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:13.692387 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:13.692821 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:13.823346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:13.831014 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:13.833126 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:13.834272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-9ffa34c4-3e68-420a-b209-8306b261bc1a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.154495 Apr 26 14:19:13.834825 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 479/958] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:13 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:14.122149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-ebb0df95-af0f-4003-8890-d3149ba576b4 req-5415a84b-6cc9-4548-aad3-99b41b015922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "name": "network-vif-plugged", "status": "completed", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:14.132150 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-ebb0df95-af0f-4003-8890-d3149ba576b4 req-5415a84b-6cc9-4548-aad3-99b41b015922 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.132601 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-ebb0df95-af0f-4003-8890-d3149ba576b4 req-5415a84b-6cc9-4548-aad3-99b41b015922 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:14.145719 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-ebb0df95-af0f-4003-8890-d3149ba576b4 req-5415a84b-6cc9-4548-aad3-99b41b015922 service nova] Creating event network-vif-plugged:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:19:14.150707 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-ebb0df95-af0f-4003-8890-d3149ba576b4 req-5415a84b-6cc9-4548-aad3-99b41b015922 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032709 Apr 26 14:19:14.151299 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 480/959] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:19:14.375735 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:14.376261 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:14.382588 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.383030 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:14.383789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.384215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:14.406362 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.objects.instance [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lazy-loading 'flavor' on Instance uuid 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 {{(pid=117601) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:19:14.702700 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7fe88ab9-cf96-49ba-bca2-32d45a9ebab1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "POST /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.330572 Apr 26 14:19:14.703376 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 480/960] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:19:14 2022] POST /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:19:14.711940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:14.712643 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:14.718715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.719166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:14.719936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.720369 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:14.853303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:14.855049 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:14.855758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:14.861084 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6acc41f3-1f2b-4108-9756-404298328cf5 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.153236 Apr 26 14:19:14.862560 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 481/961] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:14 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:14.862685 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.862998 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:14.863769 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:14.864194 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:15.001414 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:15.009250 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:15.010783 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:15.011883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-0675814f-3e48-48e0-846c-81056df2bded tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1407 microversion: 2.20 time: 0.162041 Apr 26 14:19:15.012449 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 481/962] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:14 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:15.878824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:15.880059 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:15.886343 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:15.888801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:15.888801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:15.888801 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:16.025204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:16.030317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:16.030947 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:16.032626 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c241e11d-aa4d-492f-a71f-cdc176e74e68 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.157682 Apr 26 14:19:16.033204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 482/963] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:15 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:16.037574 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:16.038054 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:16.038830 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:16.039519 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:16.172215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:16.180437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:16.182004 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:16.183149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5fa7d381-7eb5-4ebe-b91d-e0f459857d00 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1598 microversion: 2.20 time: 0.156652 Apr 26 14:19:16.183706 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 482/964] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:16 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1598 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:16.200357 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:16.200849 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:16.206631 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:16.207072 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:16.207830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:16.208299 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:16.286267 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-69485056-981a-4fca-bf9a-99ed11148bd1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089660 Apr 26 14:19:16.286866 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 483/965] 10.222.0.23 () {60 vars in 1315 bytes} [Tue Apr 26 14:19:16 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:19:17.050641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:17.051248 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:17.058029 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:17.058475 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:17.059253 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:17.059683 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:17.192371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:17.200376 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b7b46671-98bf-48b5-8777-29c7df2e1fd8 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.153559 Apr 26 14:19:17.200941 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 483/966] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:17 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:17.527519 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-418c24d2-4921-4512-8b3b-b7f4dce14a7b req-bfcdf687-8e61-4435-bf15-d3c8b45f7276 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:17.535808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-418c24d2-4921-4512-8b3b-b7f4dce14a7b req-bfcdf687-8e61-4435-bf15-d3c8b45f7276 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:17.536252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-418c24d2-4921-4512-8b3b-b7f4dce14a7b req-bfcdf687-8e61-4435-bf15-d3c8b45f7276 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:17.547268 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-418c24d2-4921-4512-8b3b-b7f4dce14a7b req-bfcdf687-8e61-4435-bf15-d3c8b45f7276 service nova] Creating event network-changed:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:19:17.552096 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-418c24d2-4921-4512-8b3b-b7f4dce14a7b req-bfcdf687-8e61-4435-bf15-d3c8b45f7276 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028668 Apr 26 14:19:17.554094 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 484/967] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:19:18.217937 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:18.218570 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:18.225698 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:18.226185 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:18.226957 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:18.227585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:18.368426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:18.376096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5e436a1f-7a3d-46d6-b6b7-d650bc58b2ea tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.162038 Apr 26 14:19:18.376920 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 484/968] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:18 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:19.394016 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:19.394716 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:19.401004 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:19.401463 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:19.402260 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:19.402700 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:19.536389 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:19.543952 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f97dcb6e-b1ab-4efa-8c42-a362fcd94f01 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.154624 Apr 26 14:19:19.544528 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 485/969] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:19 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:20.561386 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:20.562018 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:20.569046 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:20.569494 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:20.570294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:20.570729 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:20.703097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:20.711006 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f5d60d80-f2f3-4e63-bdbc-478d83c32ed9 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.153452 Apr 26 14:19:20.711579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 485/970] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:20 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:21.728786 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:21.729333 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:21.735783 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:21.736239 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:21.737011 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:21.737451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:21.870844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:21.878260 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-78a4f363-7c4c-40cc-b5fe-40cebc68da11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.153905 Apr 26 14:19:21.878831 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 486/971] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:21 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:22.895564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:22.896167 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:22.902429 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:22.902869 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:22.903625 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:22.904053 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:23.038153 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:23.045684 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b9e6dbab-f7eb-48db-9d51-e32ea42b1c5a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.153898 Apr 26 14:19:23.046294 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 486/972] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:22 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:24.062967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:24.063581 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:24.069911 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:24.070393 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:24.071159 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:24.071595 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:24.212081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:24.219411 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3fd2fae7-9b81-4923-8e3c-2912fec99091 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.160343 Apr 26 14:19:24.219973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 487/973] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:24 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:25.236579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:25.237121 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:25.243502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:25.243952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:25.244718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:25.245155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:25.375717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:25.383110 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3c32058f-6cc9-4add-9f30-05d3f6eb1c59 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.150594 Apr 26 14:19:25.383677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 487/974] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:25 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:26.400931 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:26.401543 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:26.407936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:26.408405 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:26.409174 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:26.409606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:26.543834 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:26.551282 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8a4c5c4f-7302-4f90-be49-a1805c1d15cf tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.154217 Apr 26 14:19:26.551841 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 488/975] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:26 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:27.567953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:27.568557 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:27.574724 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:27.575169 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:27.575929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:27.576389 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:27.711918 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:27.719286 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-67b71c8a-77f9-4909-bbde-6c9dbdac8849 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.155160 Apr 26 14:19:27.719905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 488/976] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:27 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:28.736788 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:28.737584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:28.745748 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:28.745748 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:28.746135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:28.746345 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:28.880944 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:28.888547 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-765240e6-5b7d-42b4-81f3-89324d00a66f tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1568 microversion: 2.1 time: 0.155647 Apr 26 14:19:28.890609 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 489/977] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:28 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:28.905204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:28.905764 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:28.912050 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:28.912497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:28.913256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:28.913688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:29.198673 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b01195e9-c29a-4b19-8011-c1667d3f02cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "POST /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4/action" status: 202 len: 0 microversion: 2.1 time: 0.297413 Apr 26 14:19:29.199460 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 489/978] 10.222.0.23 () {60 vars in 1277 bytes} [Tue Apr 26 14:19:28 2022] POST /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:19:29.207277 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:29.207920 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:29.214243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:29.214695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:29.215475 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:29.215909 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:29.350555 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:29.357957 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8d1e283f-1593-4bcd-9f68-29a41b752cd2 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1516 microversion: 2.1 time: 0.154560 Apr 26 14:19:29.358544 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 490/979] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:29 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:30.075426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-51c0e00e-0b9d-4ed8-8446-ba5be9d816c1 req-2c25452a-7a50-4c7e-b790-010a7f5b6eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "name": "network-vif-unplugged", "status": "completed", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:30.100066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-51c0e00e-0b9d-4ed8-8446-ba5be9d816c1 req-2c25452a-7a50-4c7e-b790-010a7f5b6eba service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:30.100066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-51c0e00e-0b9d-4ed8-8446-ba5be9d816c1 req-2c25452a-7a50-4c7e-b790-010a7f5b6eba service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:30.100066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.compute.server_external_events [req-51c0e00e-0b9d-4ed8-8446-ba5be9d816c1 req-2c25452a-7a50-4c7e-b790-010a7f5b6eba service nova] Unable to find a host for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4. Dropping event network-vif-unplugged {{(pid=117601) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 26 14:19:30.100066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-51c0e00e-0b9d-4ed8-8446-ba5be9d816c1 req-2c25452a-7a50-4c7e-b790-010a7f5b6eba service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024429 Apr 26 14:19:30.100066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 490/980] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 26 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 26 14:19:30.376065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:30.376667 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:30.382999 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:30.383399 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:30.384157 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:30.384589 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:30.521186 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:30.529465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-80b89aab-4eed-49f8-b3bf-a4b47bcda562 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1516 microversion: 2.1 time: 0.158056 Apr 26 14:19:30.530037 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 491/981] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:30 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:31.546446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:31.546966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:31.553201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:31.553645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:31.554478 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:31.554909 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:31.688107 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:31.695457 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-887b39c5-af08-4e7a-bf05-c31b17329de6 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1518 microversion: 2.1 time: 0.152921 Apr 26 14:19:31.696021 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 491/982] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:31 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:32.712795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:32.713400 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:32.719858 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:32.720300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:32.721065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:32.721497 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:32.936597 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:32.943954 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-bfa97782-ad5b-4099-98ab-aef48dcffb91 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.235055 Apr 26 14:19:32.944778 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 492/983] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:32 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:33.961745 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:33.962349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:33.969340 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:33.969799 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:33.970564 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:33.971011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:34.103025 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:34.110326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-91b85f00-60c9-4c29-b7bf-8b59087feb96 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.152431 Apr 26 14:19:34.110895 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 492/984] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:33 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:35.127141 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:35.127756 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:35.133783 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:35.134266 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:35.135034 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:35.135474 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:35.268499 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:35.275787 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9ba2cf0f-a14f-4a1e-a368-0c2b4d76008e tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.152515 Apr 26 14:19:35.276358 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 493/985] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:35 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:36.292699 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:36.293784 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:36.300039 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:36.300478 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:36.301231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:36.301658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:36.431658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:36.438993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-862d3ffd-cf41-48a3-9b48-853694b50372 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.150358 Apr 26 14:19:36.439754 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 493/986] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:36 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:37.456196 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:37.456865 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:37.463158 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:37.463601 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:37.464366 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:37.465288 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:37.595537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:37.602723 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e8368664-e855-493e-b049-e3d56a4271b4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.150396 Apr 26 14:19:37.603283 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 494/987] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:37 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:38.619459 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:38.620064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:38.626974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:38.627413 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:38.628168 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:38.628597 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:38.756594 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:38.763755 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3a6f680e-69b4-4912-bdac-935bfcaa177d tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.148081 Apr 26 14:19:38.764316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 494/988] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:38 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:39.780649 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:39.781199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:39.788517 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:39.788969 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:39.790032 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:39.790471 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:39.925063 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:39.932300 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8d058515-4a92-4e93-99de-9d11fe88ea11 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.155601 Apr 26 14:19:39.932860 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 495/989] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:39 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:40.949692 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:40.950352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:40.956687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:40.957134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:40.957880 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:40.958330 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:41.093754 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:41.101317 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7d87436d-8166-4e92-924b-21835bd5ac31 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.156266 Apr 26 14:19:41.101890 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 495/990] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:40 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:42.120112 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:42.121420 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:42.127622 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:42.128068 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:42.128837 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:42.129269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:42.147526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-16d33db1-a422-4a64-9da9-6997dfdb17b8 req-a3e8741a-48aa-4f3d-8ba8-da1b0dbe84d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "name": "network-vif-plugged", "status": "completed", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:42.156124 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-16d33db1-a422-4a64-9da9-6997dfdb17b8 req-a3e8741a-48aa-4f3d-8ba8-da1b0dbe84d2 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:42.156560 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-16d33db1-a422-4a64-9da9-6997dfdb17b8 req-a3e8741a-48aa-4f3d-8ba8-da1b0dbe84d2 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:42.168178 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-16d33db1-a422-4a64-9da9-6997dfdb17b8 req-a3e8741a-48aa-4f3d-8ba8-da1b0dbe84d2 service nova] Creating event network-vif-plugged:9fb27f6a-f71d-4cc9-b31d-afcd61b0c670 for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 on hv-cinder-83513 Apr 26 14:19:42.173631 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-16d33db1-a422-4a64-9da9-6997dfdb17b8 req-a3e8741a-48aa-4f3d-8ba8-da1b0dbe84d2 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029439 Apr 26 14:19:42.174251 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 496/991] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:19:42.269536 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:42.277331 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-985000d0-5d52-47dd-80e0-9dbe19504813 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.161258 Apr 26 14:19:42.278266 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 496/992] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:42 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:43.295349 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:43.295975 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:43.302373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:43.302816 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:43.303568 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:43.303994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:43.436812 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:43.444276 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a86497d3-5bf5-465b-9b11-21c5cf784177 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1574 microversion: 2.1 time: 0.153147 Apr 26 14:19:43.444843 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 497/993] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:43 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:44.461947 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:44.462584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:44.469414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:44.469861 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:44.470661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:44.471099 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:44.603940 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:44.611173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-c5f5059b-d375-4d2a-b3bd-0b4ae299f2c1 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1561 microversion: 2.1 time: 0.153122 Apr 26 14:19:44.611735 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 497/994] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:19:44 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:19:53.388397 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:53.388953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:53.395230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:53.395676 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:53.396432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:53.396863 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:53.419290 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e00086a3-5f3d-4ce2-ac10-a77f64f61542 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/ips" status: 200 len: 151 microversion: 2.20 time: 0.035298 Apr 26 14:19:53.419842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 498/995] 10.222.0.23 () {60 vars in 1288 bytes} [Tue Apr 26 14:19:53 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:19:55.616290 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:19:55.616842 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:55.623673 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:55.627840 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:55.627840 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:55.627840 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:55.646624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lazy-loading 'flavor' on Instance uuid 019e4a26-ae44-45c7-9ced-eeccd45128e0 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:19:56.195295 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-93fa6627-061f-4f15-9430-016d6a786d0d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/action" status: 202 len: 0 microversion: 2.20 time: 0.582793 Apr 26 14:19:56.195915 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 498/996] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Apr 26 14:19:55 2022] POST /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:19:56.204224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:56.204817 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:56.210758 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:56.211209 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:56.211969 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:56.212420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:56.347551 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:56.355456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:56.362244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:56.362244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-db882189-4253-4c76-b6b5-775c8aa1e75c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.157972 Apr 26 14:19:56.362244 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 499/997] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:56 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:57.377545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:57.378269 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:57.384430 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:57.384880 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:57.385644 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:57.386105 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:57.517553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:57.525316 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:57.526869 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:57.528018 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-08c62f99-d0f3-48ec-9ebd-2c4da2bcfcf5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.155284 Apr 26 14:19:57.529102 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 499/998] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:57 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:58.546596 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:58.547208 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:58.553545 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:58.554012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:58.554778 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:58.555213 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:58.683432 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:58.691064 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:58.692555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:58.693751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-079f5912-1fa0-442a-b204-38ca96213e25 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.150994 Apr 26 14:19:58.694316 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 500/999] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:58 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:19:59.712972 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:19:59.713513 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:19:59.720339 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:59.720789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:59.721545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:19:59.721994 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:19:59.857854 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:59.865698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:59.867239 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:19:59.868417 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4a5e2c2c-687d-4edb-a249-6986f5e3a230 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.159539 Apr 26 14:19:59.868968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 500/1000] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:19:59 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:00.886746 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:00.887356 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:00.894458 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:00.894903 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:00.895672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:00.896103 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:01.033653 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:01.041816 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:01.043713 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:01.044883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-367cd33f-6334-43c2-9eab-fa0de3892f75 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.162324 Apr 26 14:20:01.045486 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 501/1001] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:00 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:20:02.063627 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:02.064232 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:02.070584 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:02.071025 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:02.071811 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:02.072238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:02.198939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:02.207065 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:02.208557 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:02.209707 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-57b7f1ca-b5fb-4c49-9e63-358f9d7f8956 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.149997 Apr 26 14:20:02.210287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 501/1002] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:02 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:03.228511 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:03.229052 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:03.235361 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:03.235805 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:03.236569 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:03.237006 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:03.364992 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:03.373156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:03.374688 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:03.375837 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-68bb9853-fab4-42a2-abe7-53b70e9b0e02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.151254 Apr 26 14:20:03.376388 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 502/1003] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:03 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:04.394081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:04.394668 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:04.400517 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:04.400960 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:04.401715 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:04.402172 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:04.531213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:04.538870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:04.540642 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:04.541795 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a42d651d-715f-4597-9c18-34c625159a93 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.151855 Apr 26 14:20:04.542380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 502/1004] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:04 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:05.559832 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:05.560436 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:05.566720 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:05.567169 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:05.567933 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:05.568366 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:05.696024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:05.704360 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:05.705838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:05.707005 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-33e33923-1f66-4a7c-9ebd-dd7405898a7c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.151051 Apr 26 14:20:05.707566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 503/1005] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:05 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:06.725509 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:06.726144 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:06.732380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:06.732833 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:06.733605 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:06.735602 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:06.865753 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:06.874394 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:06.875879 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:06.877028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3ffdbdd2-8c97-4f97-b425-8a4cf31ed85c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.155625 Apr 26 14:20:06.877575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 503/1006] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:06 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:07.895479 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:07.896093 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:07.902377 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:07.902827 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:07.903589 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:07.904020 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:08.037748 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:08.045640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:08.047180 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:08.048321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bb4d2aa4-2ac2-47af-9bcb-96aabfc8ce9a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.156685 Apr 26 14:20:08.048868 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 504/1007] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:07 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:09.066675 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:09.067292 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:09.074122 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:09.074598 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:09.075377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:09.075848 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:09.205744 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:09.214553 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:09.216072 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:09.217237 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-7c4855e4-7225-41f6-94fe-44c660db3a06 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.154714 Apr 26 14:20:09.217798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 504/1008] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:09 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:10.235373 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:10.235964 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:10.242128 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:10.242658 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:10.243426 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:10.243851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:10.372798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:10.380353 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:10.381826 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:10.383003 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-43acd2ab-62d4-4e5d-8551-7d14a8bb6ade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.151510 Apr 26 14:20:10.383548 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 505/1009] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:10 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:11.400567 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:11.401188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:11.407991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:11.408431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:11.409187 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:11.409617 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:11.597898 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:11.605523 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:11.607033 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:11.608183 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-911aa740-4bfa-4fad-a14c-43a376a76fe6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.211516 Apr 26 14:20:11.608718 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 505/1010] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:11 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:12.626463 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:12.627128 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:12.633324 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:12.633773 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:12.634568 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:12.635006 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:12.816442 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:12.824134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:12.826159 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:12.827302 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-76a74653-d5f0-430a-9d54-716c172fddef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.204800 Apr 26 14:20:12.827857 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 506/1011] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:12 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:13.845825 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:13.846476 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:13.852775 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:13.853234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:13.854035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:13.854480 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:13.984297 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:13.992049 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:13.993587 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:13.994772 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2d6f2685-9d5e-4a03-badb-764faa6809e5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.152859 Apr 26 14:20:13.995330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 506/1012] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:13 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:15.012843 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:15.013446 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:15.020099 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:15.020544 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:15.021307 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:15.021739 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:15.158411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:15.167041 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:15.170999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:15.170999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f1e93486-a752-4ed0-af53-0f3553932877 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1744 microversion: 2.20 time: 0.161422 Apr 26 14:20:15.170999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 507/1013] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:15 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:16.189046 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:16.189651 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:16.196105 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:16.211979 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:16.211979 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:16.211979 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:16.335083 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:16.342937 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:16.344586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:16.345757 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3d8d263e-60f1-47d2-9a77-d66e3f41ad02 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.160542 Apr 26 14:20:16.346352 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 507/1014] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:16 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:17.364680 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:17.365282 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:17.371555 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:17.372003 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:17.372765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:17.373231 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:17.529502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:17.541201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:17.542928 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:17.544567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fd56aabc-29df-4a89-892f-a6540f444138 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.183818 Apr 26 14:20:17.545419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 508/1015] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:17 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:18.425372 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-97bc52b2-4a23-45f3-9554-a19e16a68562 req-b8bb4e29-8909-4809-b8aa-33153fcdfd56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "name": "network-vif-plugged", "status": "completed", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:18.435176 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-97bc52b2-4a23-45f3-9554-a19e16a68562 req-b8bb4e29-8909-4809-b8aa-33153fcdfd56 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:18.435625 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-97bc52b2-4a23-45f3-9554-a19e16a68562 req-b8bb4e29-8909-4809-b8aa-33153fcdfd56 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:18.452985 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-97bc52b2-4a23-45f3-9554-a19e16a68562 req-b8bb4e29-8909-4809-b8aa-33153fcdfd56 service nova] Creating event network-vif-plugged:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:20:18.459324 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-97bc52b2-4a23-45f3-9554-a19e16a68562 req-b8bb4e29-8909-4809-b8aa-33153fcdfd56 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042124 Apr 26 14:20:18.459939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 508/1016] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:20:18.563747 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:18.564847 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:18.574097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:18.578210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:18.578210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:18.578210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:18.746494 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:18.754672 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:18.756504 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:18.757767 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-34a61dd7-7b10-4810-908d-141576b23c96 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.197906 Apr 26 14:20:18.758579 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 509/1017] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:18 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:18.794991 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2031368357", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-825254602", "security_groups": [{"name": "tempest-secgroup-smoke-445138182"}], "block_device_mapping_v2": [{"uuid": "fef77427-f381-4a37-91ff-2f41d6386b3a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9c46524c-1ef3-4576-ad52-5298a3962302"}]}} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:18.921741 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.network.neutron [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] validate_networks() for [('9c46524c-1ef3-4576-ad52-5298a3962302', None, None, None, None, None)] {{(pid=117600) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 26 14:20:19.330334 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Flavor limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 26 14:20:19.330760 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Image limits 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 26 14:20:19.332078 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Flavor pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 26 14:20:19.332489 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Image pref 0:0:0 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 26 14:20:19.332905 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.virt.hardware [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117600) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 26 14:20:19.343575 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:19.344022 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:19.344824 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:19.345260 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:19.364898 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 26 14:20:19.369503 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.quota [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Getting quotas for user 9cd225533a1e48a3a8f03339af74b851 and project 488b7e9fc3ac419e8f3acaf1bbfd8838. Resources: {'cores', 'ram', 'instances'} {{(pid=117600) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 26 14:20:19.431381 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Going to run 1 instances... {{(pid=117600) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 26 14:20:19.433617 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fef77427-f381-4a37-91ff-2f41d6386b3a',volume_size=None,volume_type=None)] {{(pid=117600) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 26 14:20:19.776761 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:19.777378 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:19.784205 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:19.787326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:19.787326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:19.787326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:19.929905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:19.939901 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:19.941381 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:19.946311 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-7b2f3963-d811-43e7-b230-84dba956b336 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.169830 Apr 26 14:20:19.947967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 510/1018] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:19 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:20:20.132547 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a0c72ba2-84ab-4d51-9411-53949aa3055c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.342307 Apr 26 14:20:20.144725 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-252d1c5f-a64e-4035-9b17-f7dc930a35ab tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:20.145584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-252d1c5f-a64e-4035-9b17-f7dc930a35ab tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:20.160272 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 509/1019] 10.222.0.23 () {60 vars in 1146 bytes} [Tue Apr 26 14:20:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 26 14:20:20.220993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-252d1c5f-a64e-4035-9b17-f7dc930a35ab tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:20.230272 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-252d1c5f-a64e-4035-9b17-f7dc930a35ab tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1094 microversion: 2.1 time: 0.089134 Apr 26 14:20:20.231802 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 511/1020] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:20 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1094 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:20.964636 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:20.966001 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:20.974188 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:20.974908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:20.975927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:20.976577 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:21.133859 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:21.143108 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:21.144622 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:21.145800 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-037d2e3a-6c72-4838-aa4c-cff5a5701a6f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.185376 Apr 26 14:20:21.148464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 510/1021] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:20 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:21.249387 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:21.250058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:21.257854 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:21.262297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:21.262297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:21.262297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:21.327966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:21.337772 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b1172609-5d7a-4714-942f-e84c55d22705 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1136 microversion: 2.1 time: 0.092515 Apr 26 14:20:21.338887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 512/1022] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:21 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1136 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:22.165135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:22.166516 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:22.177013 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:22.179193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:22.180028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:22.180460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:22.374069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:22.374069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:22.374069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:22.374069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:22.375080 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:22.375080 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:22.461716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:22.461716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-cccb3566-b9ae-4daf-8114-5814319e90e6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1210 microversion: 2.1 time: 0.106484 Apr 26 14:20:22.461716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 513/1023] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:22 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1210 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:20:22.732160 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:22.740244 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:22.742118 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:22.743524 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4ab3826f-02d3-40d7-9415-35ee63f4aee4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.583099 Apr 26 14:20:22.744130 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 511/1024] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:22 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:23.477533 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:23.484145 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:23.489137 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:23.489870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:23.490966 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:23.491690 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:23.677351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:23.685914 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d08715fe-8084-4229-a6fe-355c4a2fb59a tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1277 microversion: 2.1 time: 0.213063 Apr 26 14:20:23.687387 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 514/1025] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:23 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:23.763221 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:23.763927 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:23.774398 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:23.774658 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:23.778157 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:23.780357 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:24.038504 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:24.051202 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:24.058557 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:24.060173 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5671054a-5c5b-4569-943c-26d4cb09b68c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.301245 Apr 26 14:20:24.061125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 512/1026] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:23 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:24.534495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-63b12d80-9607-495c-a392-0d32d65784cd req-ce80aa27-8f50-47aa-b120-8dc6ebcbeddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e824471-2b62-4661-b9be-752fe9cc26f1", "tag": "eefb490f-e9ff-406d-a83d-4ad7915fe49a"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:24.546907 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-63b12d80-9607-495c-a392-0d32d65784cd req-ce80aa27-8f50-47aa-b120-8dc6ebcbeddb service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:24.547360 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-63b12d80-9607-495c-a392-0d32d65784cd req-ce80aa27-8f50-47aa-b120-8dc6ebcbeddb service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:24.576631 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-63b12d80-9607-495c-a392-0d32d65784cd req-ce80aa27-8f50-47aa-b120-8dc6ebcbeddb service nova] Creating event network-changed:eefb490f-e9ff-406d-a83d-4ad7915fe49a for instance 3e824471-2b62-4661-b9be-752fe9cc26f1 on hv-cinder-83513 Apr 26 14:20:24.583380 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-63b12d80-9607-495c-a392-0d32d65784cd req-ce80aa27-8f50-47aa-b120-8dc6ebcbeddb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053082 Apr 26 14:20:24.584674 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 515/1027] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:20:24.705699 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:24.706648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:24.723438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:24.724204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:24.725097 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:24.725648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:24.989487 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:25.011284 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f3809ad1-cdb1-4a00-9021-fb6abab82599 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.311155 Apr 26 14:20:25.019503 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 513/1028] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:24 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:25.080641 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:25.081635 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:25.088657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:25.089329 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:25.090352 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:25.091011 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:25.260945 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:25.269602 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:25.271419 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:25.272929 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-424e2930-b64b-4b16-9d4a-7ced40f1d054 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.197201 Apr 26 14:20:25.274136 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 516/1029] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:25 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:26.031999 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:26.032822 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:26.048007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:26.048495 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:26.049263 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:26.049777 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:26.189076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:26.198951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-42b38c77-7c22-4e99-ba54-64f096e2ff53 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.171954 Apr 26 14:20:26.198951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 514/1030] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:26 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:20:26.292498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:26.293584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:26.300501 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:26.303490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:26.303490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:26.303490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:26.467647 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:26.475636 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:26.477116 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:26.478326 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f469f521-65ab-414c-87e1-48eda116f469 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.190760 Apr 26 14:20:26.479437 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 517/1031] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:26 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:27.216570 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:27.217374 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:27.227526 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:27.228593 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:27.231242 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:27.231841 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:27.422871 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:27.430257 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-33af6fea-a351-4f6c-b081-3d87e9845b57 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.217744 Apr 26 14:20:27.430822 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 515/1032] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:27 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:27.496716 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:27.497263 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:27.503516 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:27.503962 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:27.504722 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:27.505153 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:27.635951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:27.643662 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:27.645153 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:27.646336 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-63da8aa1-6692-4ca0-93bf-b72f47bea6c1 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1739 microversion: 2.20 time: 0.153656 Apr 26 14:20:27.646906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 518/1033] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:27 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1739 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:28.447202 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:28.447812 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:28.454683 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:28.455135 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:28.455902 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:28.456341 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:28.592214 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:28.599465 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-3e7e5196-c85d-4f1a-aab6-f32fea45a004 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.156084 Apr 26 14:20:28.600035 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 516/1034] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:28 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:28.664682 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:28.665321 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:28.671498 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:28.671950 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:28.672851 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:28.673180 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:28.804974 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:28.812727 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:28.814246 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:28.815391 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c0405a06-16a5-4ed1-ae4c-406983c519dc tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1721 microversion: 2.20 time: 0.154798 Apr 26 14:20:28.815949 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 519/1035] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:28 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:29.616070 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:29.616705 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:29.623511 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:29.623973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:29.624712 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:29.625243 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:29.757589 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:29.765163 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f8edf425-f61f-46f0-baa2-a020a1d947d9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.152828 Apr 26 14:20:29.765904 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 517/1036] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:29 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:29.834258 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:29.834924 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:29.841749 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:29.842226 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:29.842988 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:29.843421 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:29.973127 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:29.980912 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:29.982490 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:29.983689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bd3f9c8f-4d04-4d6b-b845-8be996389087 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1721 microversion: 2.20 time: 0.153229 Apr 26 14:20:29.984256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 520/1037] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:29 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:30.418249 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-ee624156-7386-49db-8f37-fc00ffbf24b5 req-df71b578-cd1a-4172-81bc-b4175a3f76cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "name": "network-vif-unplugged", "status": "completed", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:30.426213 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-ee624156-7386-49db-8f37-fc00ffbf24b5 req-df71b578-cd1a-4172-81bc-b4175a3f76cb service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:30.426659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-ee624156-7386-49db-8f37-fc00ffbf24b5 req-df71b578-cd1a-4172-81bc-b4175a3f76cb service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:30.437776 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-ee624156-7386-49db-8f37-fc00ffbf24b5 req-df71b578-cd1a-4172-81bc-b4175a3f76cb service nova] Creating event network-vif-unplugged:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:20:30.444347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-ee624156-7386-49db-8f37-fc00ffbf24b5 req-df71b578-cd1a-4172-81bc-b4175a3f76cb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030056 Apr 26 14:20:30.445645 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 518/1038] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:20:30.781889 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:30.782518 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:30.788599 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:30.789056 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:30.790269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:30.790706 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:30.931953 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:30.939994 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-36b5568c-a5f5-4885-bc0d-34f66d9a0c4b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.162025 Apr 26 14:20:30.940591 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 521/1039] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:30 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:31.001950 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:31.002848 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:31.009492 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:31.009939 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:31.010768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:31.011204 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:31.144946 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:31.153281 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:31.154820 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:31.155980 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b2f1aecf-6722-43f6-b97a-f243abbe28a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1664 microversion: 2.20 time: 0.158234 Apr 26 14:20:31.156545 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 519/1040] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:30 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:31.174906 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fbec3cc-2941-4d07-b66c-fc38a4a90a27"}} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:31.175957 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:31.181786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:31.182278 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:31.183062 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:31.183487 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:31.956665 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:31.957280 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:31.963125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:31.963579 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:31.964351 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:31.964799 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:32.063584 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-fcf2df21-4b28-4e4d-922d-5828db30a3a2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.892565 Apr 26 14:20:32.064211 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 522/1041] 10.222.0.23 () {62 vars in 1363 bytes} [Tue Apr 26 14:20:31 2022] POST /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-volume_attachments => generated 188 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 26 14:20:32.101340 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:32.108648 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-4c036209-e1e8-479b-beaf-5e4f4bdf1c4f tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.155852 Apr 26 14:20:32.109377 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 520/1042] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:31 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:20:32.174157 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:32.174657 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:32.181157 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:32.181611 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:32.182411 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:32.182848 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:32.897670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c193872d-882c-455d-8263-3b49e0fca5ca tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-volume_attachments/0fbec3cc-2941-4d07-b66c-fc38a4a90a27" status: 202 len: 0 microversion: 2.20 time: 0.727415 Apr 26 14:20:32.899628 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 523/1043] 10.222.0.23 () {60 vars in 1456 bytes} [Tue Apr 26 14:20:32 2022] DELETE /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-volume_attachments/0fbec3cc-2941-4d07-b66c-fc38a4a90a27 => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:20:32.954347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:32.954851 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:32.960578 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:32.961033 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:32.961803 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:32.962264 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:33.126371 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:33.127110 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:33.132887 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:33.133328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:33.134101 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:33.134531 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:33.191151 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-65ca79c1-48b7-49c3-af98-9accd48a96f2 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "POST /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/action" status: 202 len: 0 microversion: 2.20 time: 0.240750 Apr 26 14:20:33.192149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 521/1044] 10.222.0.23 () {62 vars in 1318 bytes} [Tue Apr 26 14:20:32 2022] POST /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:20:33.200149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:33.200773 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:33.207007 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:33.207346 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:33.208236 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:33.208624 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:33.274566 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:33.287149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-e7d1290c-535a-48c9-a728-c67331d0f905 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.164565 Apr 26 14:20:33.287782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 524/1045] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:33 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:20:33.348782 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:33.357611 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:33.359219 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:33.360450 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-8f05c855-5923-4e1d-85c3-65fd9b482949 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1672 microversion: 2.20 time: 0.164429 Apr 26 14:20:33.361087 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 522/1046] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:33 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:34.304607 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:34.305134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:34.311905 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:34.312359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:34.313129 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:34.313567 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:34.379355 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:34.379963 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:34.388930 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:34.389434 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:34.390414 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:34.390859 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:34.496240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:34.504328 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-863c8ae0-14e7-49ed-9a42-7f483094716e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.203629 Apr 26 14:20:34.505230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 525/1047] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:34 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:34.545376 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:34.553409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:34.554993 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:34.556537 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-637d753b-121d-4ee0-91be-db16f523c8ec tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1674 microversion: 2.20 time: 0.181058 Apr 26 14:20:34.557100 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 523/1048] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:34 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:34.588255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [req-d455f377-ddf2-41ff-abcb-c3643d77a70d req-40ff3fac-897c-45b8-b4d9-d20b5bb3d58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e824471-2b62-4661-b9be-752fe9cc26f1", "name": "network-vif-plugged", "status": "completed", "tag": "eefb490f-e9ff-406d-a83d-4ad7915fe49a"}]} {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:34.596418 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-d455f377-ddf2-41ff-abcb-c3643d77a70d req-40ff3fac-897c-45b8-b4d9-d20b5bb3d58b service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:34.596860 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [req-d455f377-ddf2-41ff-abcb-c3643d77a70d req-40ff3fac-897c-45b8-b4d9-d20b5bb3d58b service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:34.608002 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.compute.server_external_events [req-d455f377-ddf2-41ff-abcb-c3643d77a70d req-40ff3fac-897c-45b8-b4d9-d20b5bb3d58b service nova] Creating event network-vif-plugged:eefb490f-e9ff-406d-a83d-4ad7915fe49a for instance 3e824471-2b62-4661-b9be-752fe9cc26f1 on hv-cinder-83513 Apr 26 14:20:34.613307 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [req-d455f377-ddf2-41ff-abcb-c3643d77a70d req-40ff3fac-897c-45b8-b4d9-d20b5bb3d58b service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028326 Apr 26 14:20:34.613456 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 526/1049] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:20:35.520635 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:35.521341 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:35.528326 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:35.528776 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:35.529548 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:35.529992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:35.577164 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:35.577999 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:35.584189 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:35.584718 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:35.585572 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:35.586030 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:35.716970 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:35.724834 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:35.726351 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:35.727502 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-c6db68d7-e2fa-4f03-896f-7699066fd239 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.155552 Apr 26 14:20:35.728073 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 527/1050] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:35 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:20:35.755124 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:35.763060 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-f24a1b6f-a8a7-4bc9-a56c-995c98f9518e tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1265 microversion: 2.1 time: 0.246323 Apr 26 14:20:35.763628 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 524/1051] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:35 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:36.745751 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:36.746493 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:36.752886 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:36.755995 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:36.755995 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:36.755995 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:36.781528 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:36.783044 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:36.792698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:36.793152 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:36.793938 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:36.794388 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:36.921677 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:36.931230 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:36.933183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:36.934734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bf3fba12-67c7-4be4-b49b-347e7f139bea tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.193772 Apr 26 14:20:36.935298 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 528/1052] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:36 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:36.972409 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:36.980053 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-034a2029-cf30-4691-ba96-cf4b7f763ea8 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1452 microversion: 2.1 time: 0.203862 Apr 26 14:20:36.980612 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 525/1053] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:36 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1452 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:20:36.997654 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:36.998136 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:37.005730 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:37.006385 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:37.007315 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:37.007951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:37.152894 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:37.161864 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8b9e39ec-d76e-40b3-98d0-7aeabe55f35c tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1452 microversion: 2.1 time: 0.168046 Apr 26 14:20:37.162469 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 529/1054] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:20:36 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:20:37.955379 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:37.956602 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:37.963017 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:37.963664 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:37.964662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:37.965259 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:38.119155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:38.131428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:38.133451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:38.135036 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-6a6a4094-63a0-4ea9-a8e8-e5de781e020f tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.184171 Apr 26 14:20:38.136215 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 526/1055] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:37 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:39.156201 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:39.156838 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:39.163035 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:39.163481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:39.164255 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:39.164951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:39.401402 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:39.410620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:39.412075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:39.413256 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f3320b3d-70f4-4c88-b7a7-ee3429c8fade tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.261786 Apr 26 14:20:39.414008 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 530/1056] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:39 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:39.619440 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-9d16233d-85b1-4ef7-ae8d-ac3194a79584 req-c902a90b-f339-4284-a86c-75417f6a96b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e824471-2b62-4661-b9be-752fe9cc26f1", "tag": "eefb490f-e9ff-406d-a83d-4ad7915fe49a"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:39.630380 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-9d16233d-85b1-4ef7-ae8d-ac3194a79584 req-c902a90b-f339-4284-a86c-75417f6a96b4 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:39.630988 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-9d16233d-85b1-4ef7-ae8d-ac3194a79584 req-c902a90b-f339-4284-a86c-75417f6a96b4 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:39.643965 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-9d16233d-85b1-4ef7-ae8d-ac3194a79584 req-c902a90b-f339-4284-a86c-75417f6a96b4 service nova] Creating event network-changed:eefb490f-e9ff-406d-a83d-4ad7915fe49a for instance 3e824471-2b62-4661-b9be-752fe9cc26f1 on hv-cinder-83513 Apr 26 14:20:39.650058 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-9d16233d-85b1-4ef7-ae8d-ac3194a79584 req-c902a90b-f339-4284-a86c-75417f6a96b4 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038112 Apr 26 14:20:39.651344 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 527/1057] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:20:40.431689 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:40.433519 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:40.441136 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:40.445224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:40.446090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:40.449670 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:40.616334 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:40.626214 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:40.627883 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:40.629090 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-aba2f6c1-556f-44a1-84c7-06088a808094 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.201366 Apr 26 14:20:40.630058 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 531/1058] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:40 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:41.649347 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:41.650695 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:41.659234 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:41.659701 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:41.660501 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:41.660923 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:41.837661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:41.846609 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:41.848130 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:41.849315 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-b71ef3f3-82da-421e-a166-3dfdce455758 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.205078 Apr 26 14:20:41.850012 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 528/1059] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:41 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:42.868100 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:42.868708 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:42.875655 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:42.876096 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:42.876858 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:42.877297 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:43.013585 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:43.022120 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:43.023621 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:43.024787 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-b1f2633c-e69a-4378-b3a5-22ec4bc457c3 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.160562 Apr 26 14:20:43.025346 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 532/1060] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:42 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:44.043428 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:44.044008 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:44.050208 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:44.050655 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:44.051413 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:44.051844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:44.179953 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:44.188165 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:44.189693 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:44.190870 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-aadbe60d-81eb-49fb-a8d8-3f963a37c60d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.151636 Apr 26 14:20:44.191431 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 529/1061] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:44 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:45.209553 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:45.210183 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:45.216986 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:45.217424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:45.218210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:45.218639 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:45.348577 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:45.356296 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:45.357798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:45.358990 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bdd499b4-31ed-42be-94d2-cab54ec6d4ed tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.153354 Apr 26 14:20:45.359546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 533/1062] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:45 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:46.377155 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:46.377746 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:46.384096 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:46.384546 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:46.385309 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:46.385749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:46.516318 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:46.524265 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:46.525789 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:46.527576 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-9e647d08-ce7b-48a7-88ee-3310633447c0 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.154393 Apr 26 14:20:46.528325 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 530/1063] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:46 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:47.546012 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:47.546651 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:47.552992 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:47.553438 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:47.554224 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:47.554659 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:47.685505 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:47.693596 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:47.695074 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:47.696229 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a2a90558-7641-49ac-a563-def3dd880c6d tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.154160 Apr 26 14:20:47.696798 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 534/1064] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:47 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:48.589908 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-0a790fe8-5270-446b-a075-55f1010f8414 req-656adeec-0c07-4f91-900a-f22da607cade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "name": "network-vif-plugged", "status": "completed", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:20:48.597808 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0a790fe8-5270-446b-a075-55f1010f8414 req-656adeec-0c07-4f91-900a-f22da607cade service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:48.598302 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-0a790fe8-5270-446b-a075-55f1010f8414 req-656adeec-0c07-4f91-900a-f22da607cade service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:48.610199 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-0a790fe8-5270-446b-a075-55f1010f8414 req-656adeec-0c07-4f91-900a-f22da607cade service nova] Creating event network-vif-plugged:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:20:48.616303 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-0a790fe8-5270-446b-a075-55f1010f8414 req-656adeec-0c07-4f91-900a-f22da607cade service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031068 Apr 26 14:20:48.616919 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 531/1065] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:20:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:20:48.715687 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:48.716247 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:48.723120 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:48.723602 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:48.724691 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:48.725306 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:48.883822 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:48.891645 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:48.900210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:48.900210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-76f59da8-e333-4118-9359-d39f4c4d9865 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.182848 Apr 26 14:20:48.900210 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 535/1066] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:48 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:49.915561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:49.916258 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:49.922973 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:49.923420 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:49.924182 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:49.924618 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:50.052753 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:50.060362 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:50.061851 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:50.063023 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-565d491c-d75d-40db-a33d-de031310dce5 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.152476 Apr 26 14:20:50.063698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 532/1067] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:49 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 26 14:20:51.081867 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:51.082546 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:51.088731 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:51.089182 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:51.089952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:51.090408 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:51.222942 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:51.231292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:51.232789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:51.233951 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-8fe55196-cc35-4690-8e6d-a9937f48a662 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1730 microversion: 2.20 time: 0.155999 Apr 26 14:20:51.234537 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 536/1068] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:51 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:20:52.251904 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:20:52.252510 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:20:52.258830 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:52.272057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:52.272057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:20:52.272057 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:20:52.388500 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:52.396092 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:52.397586 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:20:52.398759 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-08a70cff-8034-4d89-b4e5-635c1065410c tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1717 microversion: 2.20 time: 0.150723 Apr 26 14:20:52.399312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 533/1069] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:20:52 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1717 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:21:04.359142 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:04.359674 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:04.362407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-547b197a-2b42-42f6-9059-a16f93d8beef req-9be7e569-141d-40c7-9c81-b09e3f039c50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:21:04.365721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:04.366215 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:04.366993 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:04.367743 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:04.370606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-547b197a-2b42-42f6-9059-a16f93d8beef req-9be7e569-141d-40c7-9c81-b09e3f039c50 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:04.373132 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-547b197a-2b42-42f6-9059-a16f93d8beef req-9be7e569-141d-40c7-9c81-b09e3f039c50 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:04.384655 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-547b197a-2b42-42f6-9059-a16f93d8beef req-9be7e569-141d-40c7-9c81-b09e3f039c50 service nova] Creating event network-changed:9fb27f6a-f71d-4cc9-b31d-afcd61b0c670 for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 on hv-cinder-83513 Apr 26 14:21:04.390796 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-547b197a-2b42-42f6-9059-a16f93d8beef req-9be7e569-141d-40c7-9c81-b09e3f039c50 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033997 Apr 26 14:21:04.391390 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 534/1070] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:21:04.393165 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:21:04.675134 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-a61ae3fc-8018-450b-832e-ac0cec1f1ee7 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "DELETE /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 204 len: 0 microversion: 2.1 time: 0.320439 Apr 26 14:21:04.679359 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 537/1071] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:21:04 2022] DELETE /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:21:04.686721 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:04.686721 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:04.692724 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:04.693271 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:04.694149 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:04.694686 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:04.940580 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:04.950062 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-13946e1d-4499-4a71-ba67-2332ed37724a tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1567 microversion: 2.1 time: 0.268588 Apr 26 14:21:04.960891 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 535/1072] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:21:04 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1567 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:21:05.968926 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:05.969621 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:05.975859 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:05.976305 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:05.977066 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:05.977501 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:06.112340 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:06.119596 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-d487efd4-4e1a-46e2-a505-e70745dbefec tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1448 microversion: 2.1 time: 0.154945 Apr 26 14:21:06.120158 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 538/1073] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:21:05 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:21:07.120438 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-770815ed-63c4-4a71-9133-7692b258063e req-2ea8a85c-bdb9-42db-acd7-c276e82cf910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4", "name": "network-vif-deleted", "tag": "9fb27f6a-f71d-4cc9-b31d-afcd61b0c670"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:21:07.128636 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-770815ed-63c4-4a71-9133-7692b258063e req-2ea8a85c-bdb9-42db-acd7-c276e82cf910 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:07.129077 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-770815ed-63c4-4a71-9133-7692b258063e req-2ea8a85c-bdb9-42db-acd7-c276e82cf910 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:07.136447 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:07.137063 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:07.140076 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-770815ed-63c4-4a71-9133-7692b258063e req-2ea8a85c-bdb9-42db-acd7-c276e82cf910 service nova] Creating event network-vif-deleted:9fb27f6a-f71d-4cc9-b31d-afcd61b0c670 for instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 on hv-cinder-83513 Apr 26 14:21:07.143331 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:07.143870 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:07.144582 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:07.145024 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:07.145933 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-770815ed-63c4-4a71-9133-7692b258063e req-2ea8a85c-bdb9-42db-acd7-c276e82cf910 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088971 Apr 26 14:21:07.146630 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 536/1074] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:21:07.208015 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:07.213656 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-93fe4e1f-c8a6-496b-bed0-9f466995d884 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1381 microversion: 2.1 time: 0.081001 Apr 26 14:21:07.214269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 539/1075] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:21:07 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1381 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:21:08.232615 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:08.233311 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:08.239353 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:08.239798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:08.240561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:08.241001 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:08.272573 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:08.273027 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:08.273489 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.objects.instance [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lazy-loading 'fault' on Instance uuid 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 {{(pid=117600) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 26 14:21:08.314722 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '688c6bd837bf4f1cbde64e64651ff745', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ea97fcafba4e8fbdd5c7004c94eafe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:08.322467 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-caafcaff-92d8-467a-8e00-19c2063e00a4 tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 200 len: 1223 microversion: 2.1 time: 0.094921 Apr 26 14:21:08.323081 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 537/1076] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:21:08 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:21:09.339333 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:09.340509 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] [instance: 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:09.346844 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:09.347292 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:09.348071 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:09.348488 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:09.361861 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] HTTP exception thrown: Instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 could not be found. Apr 26 14:21:09.362462 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Returning 404 to user: Instance 8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:21:09.363269 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2841054b-f3ea-44dd-a1c4-92f85f7090cd tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4" status: 404 len: 111 microversion: 2.1 time: 0.027835 Apr 26 14:21:09.363786 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 540/1077] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:21:09 2022] GET /compute/v2.1/servers/8ee8783c-0b40-42a5-ab5f-47d5d5a5c0b4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:21:09.598485 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-a4262285-4df2-46f5-9005-d139e024242c tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] Calling method '.version_select at 0x7f4066c8dca0>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:09.670636 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-a4262285-4df2-46f5-9005-d139e024242c tempest-TestShelveInstance-1049013006 tempest-TestShelveInstance-1049013006-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476611449" status: 202 len: 0 microversion: 2.1 time: 0.075933 Apr 26 14:21:09.671221 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 538/1078] 10.222.0.23 () {58 vars in 1250 bytes} [Tue Apr 26 14:21:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-476611449 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 26 14:21:24.656744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:24.657734 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:24.663717 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:24.664162 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:24.665188 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:24.665620 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:24.693619 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-04ed88fd-e16a-4550-981a-088e1d31da91 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040690 Apr 26 14:21:24.694110 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 541/1079] 10.222.0.23 () {60 vars in 1342 bytes} [Tue Apr 26 14:21:24 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:21:24.749768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:24.750287 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:24.757305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:24.757752 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:24.758540 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:24.758974 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:24.781345 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Going to try to terminate instance {{(pid=117600) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:21:25.057606 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-35af9bdc-b32e-4ba3-be75-156d9a9f8913 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 204 len: 0 microversion: 2.20 time: 0.311950 Apr 26 14:21:25.058862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 539/1080] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Apr 26 14:21:24 2022] DELETE /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 26 14:21:25.066967 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:25.067576 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:25.073451 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:25.073904 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:25.074701 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:25.075132 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:25.205782 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:25.213599 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:25.215646 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:25.216791 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-1a37a171-72c8-4825-862a-76bd7edee6d4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.153666 Apr 26 14:21:25.217348 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 542/1081] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:21:25 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:21:26.236187 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:26.236890 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:26.243305 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:26.243752 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:26.244525 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:26.244968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:26.384272 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:26.392245 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:26.393793 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:26.395028 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-d2e6e690-9d06-462f-8729-2fab16007d0e tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1723 microversion: 2.20 time: 0.163073 Apr 26 14:21:26.395569 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 540/1082] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:21:26 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:21:27.412616 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:27.413345 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:27.420526 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:27.420970 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:27.421744 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:27.422193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:27.498240 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:27.514295 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:27.515853 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '7bee532aeccf4bfe84c0e984651524dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceae37df7abe4226ab88abbc1d289a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:21:27.517016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5ebd861b-f270-4d34-8509-427292662aef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 200 len: 1655 microversion: 2.20 time: 0.108272 Apr 26 14:21:27.521765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 543/1083] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:21:27 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 1655 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 26 14:21:27.523992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-3b69214b-66a5-4d35-8db2-d02835edf51d req-76407a95-f74b-4750-8129-a938181ff5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "019e4a26-ae44-45c7-9ced-eeccd45128e0", "name": "network-vif-deleted", "tag": "6e08a9a3-5f22-413d-9915-7b85302213b0"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:21:27.540014 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-3b69214b-66a5-4d35-8db2-d02835edf51d req-76407a95-f74b-4750-8129-a938181ff5fd service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:27.540464 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-3b69214b-66a5-4d35-8db2-d02835edf51d req-76407a95-f74b-4750-8129-a938181ff5fd service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:27.552989 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-3b69214b-66a5-4d35-8db2-d02835edf51d req-76407a95-f74b-4750-8129-a938181ff5fd service nova] Creating event network-vif-deleted:6e08a9a3-5f22-413d-9915-7b85302213b0 for instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 on hv-cinder-83513 Apr 26 14:21:27.558749 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-3b69214b-66a5-4d35-8db2-d02835edf51d req-76407a95-f74b-4750-8129-a938181ff5fd service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039029 Apr 26 14:21:27.559899 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 541/1084] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:21:28.535663 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:28.536251 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:28.543443 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:28.544461 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:28.545239 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:28.545859 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:28.559679 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] HTTP exception thrown: Instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 could not be found. Apr 26 14:21:28.560227 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Returning 404 to user: Instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:21:28.561057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-06326fa0-f81b-43d4-bf9f-2c3b4befe86a tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 404 len: 111 microversion: 2.20 time: 0.029448 Apr 26 14:21:28.561583 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 544/1085] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:21:28 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:21:28.571100 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-fd061703-e20e-49b3-8eec-2e8606a50ce4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '.version_select at 0x7f4066c5a820>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:28.624294 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-fd061703-e20e-49b3-8eec-2e8606a50ce4 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-306742367" status: 204 len: 0 microversion: 2.20 time: 0.057912 Apr 26 14:21:28.624885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 542/1086] 10.222.0.23 () {60 vars in 1258 bytes} [Tue Apr 26 14:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-306742367 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 26 14:21:30.572383 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:30.572897 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:30.579759 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:30.580203 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:30.580984 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:30.581400 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:30.594156 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] HTTP exception thrown: Instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 could not be found. Apr 26 14:21:30.594730 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Returning 404 to user: Instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:21:30.595534 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-f5b1505c-8e50-4598-8ef7-856ea3909cef tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 404 len: 111 microversion: 2.20 time: 0.027050 Apr 26 14:21:30.596041 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 545/1087] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Apr 26 14:21:30 2022] DELETE /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:21:30.604320 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:30.605048 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 019e4a26-ae44-45c7-9ced-eeccd45128e0] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:30.611550 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:30.611998 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:30.612766 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:30.613209 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:30.626282 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] HTTP exception thrown: Instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 could not be found. Apr 26 14:21:30.626862 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Returning 404 to user: Instance 019e4a26-ae44-45c7-9ced-eeccd45128e0 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:21:30.627674 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-44d1b566-dd50-4e77-a85c-53dfc1419da8 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0" status: 404 len: 111 microversion: 2.20 time: 0.027765 Apr 26 14:21:30.628194 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 543/1088] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:21:30 2022] GET /compute/v2.1/servers/019e4a26-ae44-45c7-9ced-eeccd45128e0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:21:31.839630 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:31.840124 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:31.846424 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:31.846875 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:31.847640 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:31.848076 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:31.860874 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] HTTP exception thrown: Instance 19eb5dea-2ee7-4a41-9058-de514304256b could not be found. Apr 26 14:21:31.861451 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Returning 404 to user: Instance 19eb5dea-2ee7-4a41-9058-de514304256b could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:21:31.862298 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3a4d798a-d108-4583-ab5a-96036d9e7de6 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "DELETE /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 404 len: 111 microversion: 2.20 time: 0.026627 Apr 26 14:21:31.862842 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 546/1089] 10.222.0.23 () {60 vars in 1279 bytes} [Tue Apr 26 14:21:31 2022] DELETE /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:21:31.871125 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:21:31.871739 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] [instance: 19eb5dea-2ee7-4a41-9058-de514304256b] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:21:31.877978 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:31.878445 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:31.879210 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:21:31.879647 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:21:31.892892 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] HTTP exception thrown: Instance 19eb5dea-2ee7-4a41-9058-de514304256b could not be found. Apr 26 14:21:31.893470 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] Returning 404 to user: Instance 19eb5dea-2ee7-4a41-9058-de514304256b could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:21:31.894312 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-2927f258-14d8-4f64-8b1c-a9afa4977479 tempest-AttachVolumeShelveTestJSON-700537266 tempest-AttachVolumeShelveTestJSON-700537266-project] 10.222.0.23 "GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b" status: 404 len: 111 microversion: 2.20 time: 0.027529 Apr 26 14:21:31.894827 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 544/1090] 10.222.0.23 () {60 vars in 1276 bytes} [Tue Apr 26 14:21:31 2022] GET /compute/v2.1/servers/19eb5dea-2ee7-4a41-9058-de514304256b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 26 14:21:47.601301 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:21:47.601892 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: Tue Apr 26 14:21:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:22:19.902495 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:19.903314 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:19.904036 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-03ff691a-94d5-4d17-9425-e3b61f8e2285 req-b02a0e55-8666-4150-a26a-e6f3c988cbdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e824471-2b62-4661-b9be-752fe9cc26f1", "tag": "eefb490f-e9ff-406d-a83d-4ad7915fe49a"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:22:19.912204 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:19.912789 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:19.913047 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-03ff691a-94d5-4d17-9425-e3b61f8e2285 req-b02a0e55-8666-4150-a26a-e6f3c988cbdb service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:19.913662 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-03ff691a-94d5-4d17-9425-e3b61f8e2285 req-b02a0e55-8666-4150-a26a-e6f3c988cbdb service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:19.914069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:19.914879 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:19.927867 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-03ff691a-94d5-4d17-9425-e3b61f8e2285 req-b02a0e55-8666-4150-a26a-e6f3c988cbdb service nova] Creating event network-changed:eefb490f-e9ff-406d-a83d-4ad7915fe49a for instance 3e824471-2b62-4661-b9be-752fe9cc26f1 on hv-cinder-83513 Apr 26 14:22:19.933254 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-03ff691a-94d5-4d17-9425-e3b61f8e2285 req-b02a0e55-8666-4150-a26a-e6f3c988cbdb service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033305 Apr 26 14:22:19.934407 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 545/1091] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:22:19.955246 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:22:20.262998 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-928be2de-787b-4dc7-bde3-d6481e4b7f69 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 204 len: 0 microversion: 2.1 time: 0.365099 Apr 26 14:22:20.268069 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 547/1092] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:22:19 2022] DELETE /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:22:20.279194 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:20.280200 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:20.288171 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:20.288967 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:20.290245 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:20.290844 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:20.591192 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:22:20.598636 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-26178e71-e64e-4317-a9d5-1655b020f4e9 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1577 microversion: 2.1 time: 0.329493 Apr 26 14:22:20.599739 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 546/1093] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:20 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1577 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 26 14:22:21.617055 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:21.617794 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:21.624072 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:21.624610 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:21.625381 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:21.625817 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:21.761177 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:22:21.768530 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-4d5e3cfb-050e-4b9e-8667-5502fe8f43cd tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1458 microversion: 2.1 time: 0.155643 Apr 26 14:22:21.769097 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 548/1094] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:21 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:22:22.370024 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-9decf0ff-2d23-4eff-b538-0b0a3ec73a06 req-47b8f44e-409f-4d42-ac9e-595042c8dfed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e824471-2b62-4661-b9be-752fe9cc26f1", "name": "network-vif-deleted", "tag": "eefb490f-e9ff-406d-a83d-4ad7915fe49a"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:22:22.378385 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-9decf0ff-2d23-4eff-b538-0b0a3ec73a06 req-47b8f44e-409f-4d42-ac9e-595042c8dfed service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:22.378827 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-9decf0ff-2d23-4eff-b538-0b0a3ec73a06 req-47b8f44e-409f-4d42-ac9e-595042c8dfed service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:22.390042 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-9decf0ff-2d23-4eff-b538-0b0a3ec73a06 req-47b8f44e-409f-4d42-ac9e-595042c8dfed service nova] Creating event network-vif-deleted:eefb490f-e9ff-406d-a83d-4ad7915fe49a for instance 3e824471-2b62-4661-b9be-752fe9cc26f1 on hv-cinder-83513 Apr 26 14:22:22.394981 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-9decf0ff-2d23-4eff-b538-0b0a3ec73a06 req-47b8f44e-409f-4d42-ac9e-595042c8dfed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029245 Apr 26 14:22:22.401401 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 547/1095] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:22:22.787363 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:22.788111 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:22.795894 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:22.796507 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:22.797353 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:22.797815 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:22.871086 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:22:22.879118 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-569fd76f-0904-477f-bf59-33a08790aee4 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 200 len: 1225 microversion: 2.1 time: 0.096756 Apr 26 14:22:22.879878 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 549/1096] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:22 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:22:23.896747 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:23.897475 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: 3e824471-2b62-4661-b9be-752fe9cc26f1] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:23.903750 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:23.903976 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:23.904755 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:23.905193 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:23.919543 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] HTTP exception thrown: Instance 3e824471-2b62-4661-b9be-752fe9cc26f1 could not be found. Apr 26 14:22:23.920127 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Returning 404 to user: Instance 3e824471-2b62-4661-b9be-752fe9cc26f1 could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:22:23.920951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-e2b6e13f-c9cf-446a-b919-e24352df7673 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1" status: 404 len: 111 microversion: 2.1 time: 0.028845 Apr 26 14:22:23.921483 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 548/1097] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:23 2022] GET /compute/v2.1/servers/3e824471-2b62-4661-b9be-752fe9cc26f1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:22:27.224016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:27.224563 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:27.226731 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-5ee6c1ac-5fb4-4c3c-8da3-1691920390b3 req-0f84e17e-6d4b-40c5-b652-e220424588ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4237844-3d33-4a71-82aa-c4546b5cab6c", "tag": "7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:22:27.231445 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:27.231997 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:27.232853 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:27.233347 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:27.235802 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5ee6c1ac-5fb4-4c3c-8da3-1691920390b3 req-0f84e17e-6d4b-40c5-b652-e220424588ed service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:27.236252 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-5ee6c1ac-5fb4-4c3c-8da3-1691920390b3 req-0f84e17e-6d4b-40c5-b652-e220424588ed service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:27.248255 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-5ee6c1ac-5fb4-4c3c-8da3-1691920390b3 req-0f84e17e-6d4b-40c5-b652-e220424588ed service nova] Creating event network-changed:7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1 for instance e4237844-3d33-4a71-82aa-c4546b5cab6c on hv-cinder-83513 Apr 26 14:22:27.253525 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-5ee6c1ac-5fb4-4c3c-8da3-1691920390b3 req-0f84e17e-6d4b-40c5-b652-e220424588ed service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030584 Apr 26 14:22:27.254161 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 549/1098] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 26 14:22:27.258954 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Going to try to terminate instance {{(pid=117601) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 26 14:22:27.582284 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-bd4ab5f3-0923-4ede-bf2e-74a9f6be475b tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 204 len: 0 microversion: 2.1 time: 0.362201 Apr 26 14:22:27.583057 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 550/1099] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:22:27 2022] DELETE /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 26 14:22:27.592561 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:27.593768 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:27.600103 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:27.600661 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:27.601805 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:27.602330 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:27.833194 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.policy [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117600) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:22:27.843158 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-23676a0c-16ae-448e-af0c-929eab9e1630 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1576 microversion: 2.1 time: 0.253823 Apr 26 14:22:27.844659 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 550/1100] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:27 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1576 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:22:28.861217 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:28.861917 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:28.868812 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:28.869258 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:28.870045 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:28.870483 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:29.003481 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:22:29.011193 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-5b447987-d703-49c1-a5d8-a360be964600 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1458 microversion: 2.1 time: 0.154213 Apr 26 14:22:29.011765 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 551/1101] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:28 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1458 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:22:29.614698 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [req-45cca280-31c2-410c-a908-a00cf0585c16 req-bd217ec2-47a3-41cb-b06c-6de947aac131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4237844-3d33-4a71-82aa-c4546b5cab6c", "name": "network-vif-deleted", "tag": "7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1"}]} {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 26 14:22:29.622804 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-45cca280-31c2-410c-a908-a00cf0585c16 req-bd217ec2-47a3-41cb-b06c-6de947aac131 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:29.627166 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [req-45cca280-31c2-410c-a908-a00cf0585c16 req-bd217ec2-47a3-41cb-b06c-6de947aac131 service nova] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:29.633572 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.compute.server_external_events [req-45cca280-31c2-410c-a908-a00cf0585c16 req-bd217ec2-47a3-41cb-b06c-6de947aac131 service nova] Creating event network-vif-deleted:7f3ded95-efcc-4fa2-9de9-f5e3b8709fa1 for instance e4237844-3d33-4a71-82aa-c4546b5cab6c on hv-cinder-83513 Apr 26 14:22:29.638344 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [req-45cca280-31c2-410c-a908-a00cf0585c16 req-bd217ec2-47a3-41cb-b06c-6de947aac131 service nova] 10.222.0.23 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027227 Apr 26 14:22:29.638910 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 551/1102] 10.222.0.23 () {64 vars in 1317 bytes} [Tue Apr 26 14:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 26 14:22:30.029010 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:30.042420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:30.042420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:30.042420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:30.042420 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:30.043054 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:30.095793 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.policy [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cd225533a1e48a3a8f03339af74b851', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '488b7e9fc3ac419e8f3acaf1bbfd8838', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117601) authorize /opt/stack/nova/nova/policy.py:199}} Apr 26 14:22:30.103165 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-414ba45e-f608-4657-b873-97305fcff6a6 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 200 len: 1225 microversion: 2.1 time: 0.078929 Apr 26 14:22:30.103723 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 552/1103] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:30 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 1225 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 26 14:22:31.121019 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:31.121710 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: e4237844-3d33-4a71-82aa-c4546b5cab6c] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:31.127737 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:31.128178 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:31.128936 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:31.129367 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:31.141842 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] HTTP exception thrown: Instance e4237844-3d33-4a71-82aa-c4546b5cab6c could not be found. Apr 26 14:22:31.142437 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Returning 404 to user: Instance e4237844-3d33-4a71-82aa-c4546b5cab6c could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:22:31.143238 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-5ef9896d-2d21-4c2b-b420-1738ae01c969 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c" status: 404 len: 111 microversion: 2.1 time: 0.027094 Apr 26 14:22:31.143992 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 552/1104] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:31 2022] GET /compute/v2.1/servers/e4237844-3d33-4a71-82aa-c4546b5cab6c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:22:31.633775 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:31.634338 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.compute.api [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117601) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:31.640543 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:31.640985 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:31.641740 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:31.642199 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG oslo_concurrency.lockutils [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117601) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:31.655149 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.wsgi [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] HTTP exception thrown: Instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac could not be found. Apr 26 14:22:31.655721 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Returning 404 to user: Instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac could not be found. {{(pid=117601) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:22:31.656523 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-2107a045-12b7-4600-bd74-9de651636ba3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "DELETE /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 404 len: 111 microversion: 2.1 time: 0.026739 Apr 26 14:22:31.657042 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 553/1105] 10.222.0.23 () {58 vars in 1238 bytes} [Tue Apr 26 14:22:31 2022] DELETE /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:22:31.665802 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '>' {{(pid=117600) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:31.666460 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.compute.api [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] [instance: a4be11a3-72a9-4428-8e09-81d7f82eb3ac] Fetching instance by UUID {{(pid=117600) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 26 14:22:31.672251 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:31.672694 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:31.673455 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 26 14:22:31.673885 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG oslo_concurrency.lockutils [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Lock "369c8e97-82c0-45fb-9c79-9f2a76ac131a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117600) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 26 14:22:31.687074 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.wsgi [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] HTTP exception thrown: Instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac could not be found. Apr 26 14:22:31.687646 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: DEBUG nova.api.openstack.wsgi [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Returning 404 to user: Instance a4be11a3-72a9-4428-8e09-81d7f82eb3ac could not be found. {{(pid=117600) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 26 14:22:31.688440 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO nova.api.openstack.requestlog [None req-116b75ea-b6e5-41f6-8d1e-9200699df6d3 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac" status: 404 len: 111 microversion: 2.1 time: 0.027306 Apr 26 14:22:31.688951 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: [pid: 117600|app: 0|req: 553/1106] 10.222.0.23 () {58 vars in 1235 bytes} [Tue Apr 26 14:22:31 2022] GET /compute/v2.1/servers/a4be11a3-72a9-4428-8e09-81d7f82eb3ac => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 26 14:22:33.203406 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: DEBUG nova.api.openstack.wsgi [None req-3641e3f9-a512-4eb1-b936-c6686647e567 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] Calling method '.version_select at 0x7f4066ac2790>' {{(pid=117601) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 26 14:22:33.280117 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO nova.api.openstack.requestlog [None req-3641e3f9-a512-4eb1-b936-c6686647e567 tempest-TestVolumeBootPattern-2121529974 tempest-TestVolumeBootPattern-2121529974-project] 10.222.0.23 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-825254602" status: 202 len: 0 microversion: 2.1 time: 0.080427 Apr 26 14:22:33.280694 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: [pid: 117601|app: 0|req: 554/1107] 10.222.0.23 () {58 vars in 1259 bytes} [Tue Apr 26 14:22:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-825254602 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 26 14:23:34.354351 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:23:34.354968 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: Tue Apr 26 14:23:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:25:07.610338 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:25:07.611016 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: Tue Apr 26 14:25:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:25:26.767155 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:25:26.767952 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: Tue Apr 26 14:25:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:25:31.228451 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:25:31.229005 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: Tue Apr 26 14:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:25:39.508497 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:25:39.509075 dv-cinder-835133-2-iscsi devstack@n-api.service[117601]: Tue Apr 26 14:25:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:26:54.363003 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:26:54.363798 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: Tue Apr 26 14:26:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 26 14:27:04.462693 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 26 14:27:04.463285 dv-cinder-835133-2-iscsi devstack@n-api.service[117600]: Tue Apr 26 14:27:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!